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EFFECTS OF EXTENDED EFFORT IN CREATIVE 
PROBLEM SOLVING’ 


SIDNEY 


Several studies have demonstrated 
the possibility of the deliberate de- 
velopment of individual creativity 
through educational programs 
(Parnes, 1958, 1960; Taylor, 1959). 
Two experiments evaluated the cre- 
ative problem solving course (Parnes, 
1959) conducted at the University of 
Buffalo since 1949 (Meadow & Parnes, 
1959; Parnes & Meadow, 1960). In 
the creative problem solving course a 
variety of principles and procedures 
are used to develop creative ability. 
studies have the 
effectiveness of the particular brain- 
storming principle (Osborn, 1957) of 
deferred judgment during idea pro- 
duction (Meadow, Parnes, & Reese, 
1959; Parnes & Meadow, 1959). Tay- 
lor studied the use of the principle 
among groups vs. individuals (Taylor, 
Berry, & Block, 1957). 

An additional result of the Parnes 
and Meadow (1959) study indicated a 
positive correlation between quantity 
and quality of ideas. The relationship 
between quantity and quality of ideas 
has been of great interest in the study 


Two demonstrated 


‘This research was financed by a grant 
from the Creative Education Foundation 

* The author is indebted to Hayne Reese 
for his constructive review of this paper, as 
well as for his assistance with the statistical 
in aly ses 


J 


Oo 


117 


PARNES? 


f Buffalo 


of creative problem solving activities 
Or 


1e principle stressed in the course is 
that copious idea production leads to 
more creativity in problem solving 
Osborn and others have emphasized 
this need for fluency of ideas. Instruc- 
tors have reported a prevalence oi 
better ideas at the end of an idea pro- 
duction period than at the beginning 
1959). Previous experimen- 
ters found increases in remoteness of 
and ol 
sponse among succeeding responses on 
creative tasks (Christensen, Guilford 
& Wilson, 1957). 

The present study involved two ex- 
periments designed to test the princi- 
ple that extended effort in idea pro- 
duction will lead to 
proportion rood 


creased production. 


(Parnes, 


response uncommonness re- 


an increasing 


of ideas with in- 


EXPERIMENT I 


The hypothesis was formulated in 
Experiment I that 
will appear in the last half of a sub- 
ject’s total idea output regarding a 
creative thinking problem than during 
the first half. It was also decided to 
test for any difference between high 
and low producers in the proportions 
of their good ideas that fall in the sec- 


ond half 


more good ideas 
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Method 

Subjects. Data were available from two 
groups of subjects. Group 1 consisted of 68 
students registered (but uninstructed) in 
the creative problem solving course at the 
University of Buffalo. Group 2 was com- 
prised of 78 students enrolled in other un- 
dergraduate courses at the university. The 
data for the two groups were not combined 
because a cursory examination gave reason 
to suspect that the groups might differ 
(Their averages on the experimental prob- 
lem were 79 and 6.7, respectively.) Accord- 
ingly, a statistical treatment was applied 
which allowed the use of all the data, but 
took into account this possible difference 

Experimental problem. The Hanger prob- 
lem used in the present experiment was se- 
lected from Part V of the AC Test of Crea- 
tive Ability. This test is reported to have 
differentiated groups of creative from non- 
creative subjects (Harris & Simberg, 1954) 
Data are available from a previous experi- 
ment which indicated that scores on the 
Hanger problem are positively correlated 
with other tests which have been designed 
to measure creative thinking (Meadow & 
Parnes, 1959)* Instructions for the Hanger 
problem required subjects to list all possible 
uses for an ordinary wire coat hanger. Time 
limit for the test was 5 minutes. 

Ratings. The test was group administered 
during regular class periods. The scoring 
procedure was modified to yield a quantity 
and quality score instead of a quantity and 
uniqueness score, as reported in the previous 
experiment (Meadow & Parnes, 1959). Each 
response was scored, by a trained research 
assistant, as indicating either good or bad 
quality. The quality score was defined as 
comprising two dimensions: uniqueness— 
degree to which the response departed from 
the hanger’s conventional use and value— 
the degree to which the response was judged 
to have social, economic, esthetic, or other 
usefulness. 

The scorer was instructed to rate each re- 
sponse on a three-point scale for uniqueness 
and a three-point scale for value. The re- 
sponse was finally scored as indicating good 





*Scores on the Hanger problem in the 
previous experiment correlated with other 
creative ability tests as follows: Guilford’s 
Unusual Uses, 473; Guilford’s Plot Titles 
High, 452; Guilford’s Apparatus, 301; TAT 
Originality, 520. All but the Apparatus cor- 
relation were at the .01 level of significance. 
The correlation with the Apparatus test was 
significant at the 05 level 
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quality if assigned a combined uniqueness 
and value score of at least 5. Final quality 
score used was the total number of “good 
quality” responses. Any response which du- 
plicated (in essential meaning) responses al- 
ready given was eliminated from the scoring 

The rater had no knowledge of the pur- 
pose of this study; therefore, there was no 
reason to suspect any bias in ratings of early 
ideas vs. later ideas. Interrater reliability 
for ratings of 50 subjects selected at random 
was 74 

Procedure. The subjects were divided into 
subgroups on the basis of their total quan- 
tities of ideas. Group 1 was divided at its 
median of 79, and Group 2 at its median 
of 6.7. The subjects with a total number of 
ideas less than the median were assigned to 
Subgroup L, and those with a total number 
of ideas greater than the median were as- 
signed to Subgroup H. To obtain propor- 
tional cell frequencies for the analysis of 
variance, the data of 12 subjects, 6 from each 
group, were eliminated in a random manner, 
with the restriction that their total number 
of ideas near the median. There re- 
mained 62 Group 1 and 72 Group 2 subjects 

Each subject’s data were divided into 
halves on the basis of his total number of 
ideas. Those subjects with an odd number of 
ideas were treated as follows: If the middle 
idea was a good one, it was divided between 
the halves by adding one-half point to the 
score for each half. 


was 


Results and Discussion 

Table 1 presents the mean number 
of “good” ideas in each half for each 
group. There were more good ideas in 
the second half than in the first half, 
and more good ideas in Subgroup H 
than in Subgroup L, but there was 
little difference between Group 1 and 
Group 2. A Lindquist Type III anal- 
ysis of variance of these data, (Lind- 
quist, 1956) indicated highly signifi- 
cant differences between Half I and 
Half II (F = 32.16; df = 1,130; p « 
.001) and between Subgroups L and H 
(F = 56.37; df = 1,130; p < .001). No 
other differences were statistically re- 
liable. 

The results of the experiment indi- 
cate that extended effort in producing 
ideas on a creative thinking problem 
tends to reward subjects with a greater 
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proportion of good ideas in the second 
half of their total output. As in a pre- 
vious experiment (Parnes & Meadow, 
1959) a significant relationship was 
found between quantity and quality 
of ideas. There was no significant dif- 
ference between high and low pro- 
ducers in their proportions of good 
ideas in the second half of total pro- 
duction. 

The findings support Osborn’s the- 
ory (1957) that in idea production, 
quantity leads to quality. The results 
also seem to be in accordance with 
Gordon’s explanation of “deferment” 
in the creative process. He describes 
deferment as “the capacity to discard 
the glittering immediate in favor of a 
shadowy but possibly richer future” 
(Gordon, 1956). The noncreative 
problem solver gets an idea, sees it as 
a possible solution to his problem, and 
settles for it without further ado. The 
creative problem solver is not satisfied 
with his first idea. Like the person who 
invests money to obtain greater re- 
wards later, the creative person for- 
goes the immediate reward of apply- 
ing his first idea, in expectation of a 
better solution (greater reward) ulti- 
mately. A further hypothesis suggested 
by Osborn’s and Gordon’s theories is 
that the best idea will come late in the 
total production period. The author is 
currently considering experiments to 
test this particular hypothesis. 


EXPERIMENT II 


Experiment II was designed to de- 
termine whether the type of results 
found in Experiment I with untrained 
subjects would also occur with sub- 
jects trained in the use of the brain- 
storming principle of deferred judg- 
ment. It was also decided to lengthen 
the time period to 15 minutes instead 
of 5, in order to see if a trend could be 
observed towards increasingly greater 


TABLE 1 
Mean NumBer or Goop IDEAS AMONG 
First AND Seconp Hatves or ALL 
IDEAS AND AMONG ALL IpgEaASs 


First Second 


Half Half | All Ideas 


Group 


Group 1 
Low 
High 
Mean 


Group 2 
Low 
High 
Mean 

Combined 
Low 


High 54 


All Subjects 07 81 
Mean 


Note.—Low refers to the group whose total number of 


ideas was leas than the median number of ideas; High 
refers to the group whose total number of ideas was 
greater than the median number of ideas 


proportions of good ideas as a subject’s 
total quantity increases. 


Method 


Subjects. Forty-two students in two crea- 
tive problem solving classes at the Univer- 
sity of Buffalo served as subjects. The ex- 
conducted during the final 


course 


periment was 
half of the 

Experimental problem. The Hanger prob- 
lem was used as in Experiment I. However, 
the trained students were very familiar with 
the brainstorming principle. Therefore, they 
urged to follow this principle of de- 
ferred judgment during their idea produc- 
tion. Time limit was 15 minutes 

Ratings. The same rating system was 
used as in Experiment I. However, before 
the new experiment was conducted, the rater 
had already been told the purpose of the 
original study. If he were given the subjects’ 
protocols, his ratings of the ideas might have 
been influenced this time by the relative 
position of each idea on the page. Accord- 
ingly, the rater was given each subject’s list 
of ideas typed onto new sheets in alphabeti- 
cal order. Thus he did not know the position 
of an idea in a subject's total list of ideas 
After the rater had scored the ideas on the 


were 
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typed sheets, clericals transferred these rat- 
ings back to the subjects’ original lists 
Procedure. The total list of ideas of each 
subject was then divided into thirds—a first 
third, a middle third, and a last third in a 
similar manner as to divide the 
total ideas into halves in Experiment I 


was used 


Results and Discussion 


The mean numbers of good ideas 
per third were 4.84, 5.09, and 5.81 for 
the first, middle, and last thirds, re- 
spectively. The analysis of variance of 
these data indicated that the main ef- 
fect of thirds was significant (F 
4.12; df = 2,84; p < .05). ¢t tests 
showed that the mean for the last 
third was significantly greater than 
the means for both the first third (¢ 
2.75; df = 84; p < .01) and the mid- 
dle third (t = 2.04; df = 84; p < .05) 
The means for the first and middle 
thirds did not differ significantly (¢ < 
1.00). Thus the findings of Experi- 
ment I are supported, and a trend is 
suggested towards increasingly larger 
proportions of good ideas with in- 
creased quantity. The results seem to 
provide further interest in the hypoth- 
esis that the best idea will come late 
in the total production period. 

The data of the first 5 minutes only* 
were examined on the same basis as 
Experiment I. For these first 5 min- 
utes, a mean of 3.02 good ideas were 
produced in the first half of total ideas 
and a mean of 3.26 in the second half. 
Analysis of variance of these data in- 
dicated that these means were not sig- 
nificantly different. It is interesting to 
note that these means are both almost 
double to triple the means for the un- 
trained subjects reported in the results 
section of Experiment I. This supports 
the evidence of the earlier experiments 
which demonstrated the effectiveness 
of the brainstorming principle and of 

‘Subjects had been requested at periodic 


time intervals during Experiment II to draw 
a line under their last idea 
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training in its use (Meadow et al.., 
1959; Parnes & Meadow, 1959). 


DISCUSSION 


Examination of the protocols sug- 
gested that the untrained subjects of 
Experiment I seem to start their pro- 
duction with more of the conventional, 
unoriginal ideas—high in usefulness 
but low in uniqueness. Toward the end 
of a 5-minute period, however, these 
untrained may find them- 
selves exhausted of these ideas, and 
may begin groping for less obvious 
This may lead to their greate1 
production, among the later ideas, of 
high in both usefulness 
uniqueness, the criteria for the “good” 


subjects 


ones 


ones and 
ideas. This seems to be consistent with 
the findings of Christensen 
(1957), where uncommonness and re- 


et al 


moteness of responses increased with 


succeeding responses. In the protocols 
of the trained subjects of Experiment 
II, there seem many of the 
and useful ideas among the 
but within a 15-minute pe- 
trained subjects may also 


to be 
unique 
first ones; 
riod these 
tend to exhaust themselves of ready 
ideas and find that they too have to 
“stretch” their imaginations more 
fully. This may explain why their 
strongest production of good ideas in 
the 15-minute period does not appear 
until the last third of their ideas 

In order further to explore the dif- 
ference in results between trained and 
untrained subjects, a sign test analysis 
was made of scored data on hand from 
180 untrained subjects of a previous 
experiment (Meadow & Parnes, 1959), 
for an entirely different type of prob- 
lem (Guilford’s Plot Titles) with a 
3-minute test period. These data indi- 
cated no significant difference in num- 
ber of quality ideas produced in first 
half (mean of .57) vs. half 
(mean of .62) of the idea lists. 

Thus we have data suggesting: 


second 


(a) 
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for untrained subjects, significantly 
more good ideas among /ater ideas in 
a 45-minute period, but not signifi- 
cantly more in a 3-minute stint; (b) 
for trained subjects, significantly more 
good ideas among later ideas for a 15- 
minute period, but not significantly 
more for a 5-minute stint. Theorizing 
from the four sets of related data, it 
might be suggested that subjects will 
get at least as many good ideas in the 
second half of their total idea output 
regarding a creative thinking problem 
as in the first half, but that with in- 
creasing production time, the propor- 
second half 
will increase over half. It 
might be further theorized that un- 
trained subjects will show this increas- 
ing proportion rapidly than 
trained who have already 
learned to be more creative in their 
early ideas. In a sense, both trained 
and untrained subjects 
stimulating their 
tended effort in idea-finding 
trained subjects, a 5-minuté 
(on the type of problem used) does 
not seem to be long enough to elicit 
extended effort on their parts. (This 
might be related analogously to the 
accomplished musician practicing on 
a beginner’s piece.) However, for un- 
trained subjects 5 minutes did 
to provide enough time to call for er- 
tended effort. Much further experi- 
mentation is needed with both trained 
and untrained subjects, given a variety 
of time limits and types of problems, 
in order to verify the theory suggested 


good ideas in the 


the 


tion of 
first 


more 
subjects, 


seem to be 
creativity by ez- 
For the 


period 


seem 


SUMMARY 


Experiment I was designed to test 
the hypothesis that more good ideas 
will appear in the last half of a sub- 
ject’s total idea output regarding a 


problem than during the first half 
Each subject was given a creative 
thinking problem which involved pro- 


duction of ideas for a 5-minute period 
The resultant ideas were evaluated by 
a trained rater. Number of good ideas 
was tallied for the first: half of each 
subject’s total idea list, and for the 
second half of his list 

The findings demonstrated signifi- 
cantly more good ideas to appear in 
the last half than in the first half of 
the idea lists. A significant relationship 
was also found between total quantity 
and total quality scores 

Experiment II was designed to de- 
termine whether the type of results 
found in Experiment I with untrained 
subjects would also occur with sub- 
jects trained in the use of the brain- 
storming principle of deferred judg- 
ment. It was also decided to lengthen 
the time period to 15 minutes instead 
of 5, in order to see if a trend could be 
observed towards increasingly greater 
proportions of good ideas as a subject's 
total quantity increases. Each subject 
was given 15 minutes to produce ideas 
regarding the same creative thinking 
problem as in Experiment I. Resultant 
ideas were evaluated as in the first ex- 
periment. Number of good ideas was 
tallied for each third of each subject’s 
total idea list—first third, middle 
third, and last third 

The findings showed significantly 
more good ideas to appear in the final 
third of the subjects’ idea lists. Al- 
though there not a significant 
difference between first and 
“thirds,” a trend is suggested towards 
increasingly larger proportions of 
good ideas with increased quantity 

The results are interpreted to in- 
dicate that extended effort in produc- 
ing ideas on a creative thinking prob- 
lem tends to reward problem solvers 
with a greater proportion of good ideas 
among the later ideas on their lists 
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PATTERNS OF SELF-CONCEPTUALIZATION IN 
HIGH SCHOOL AND COLLEGE STUDENTS 


WILBUR C. WASHBURN 


University of California 


Self-concepts have been related to 
aspects of child development in the 
theoretical orientations of various psy- 
chologists—Freud, Erikson, Sarbin, 
Horney, and Fromm. Although the 
specific term “self-concept” has not 
always been used, the “character 
traits” described by these writers cor- 
respond to what is now frequently 
called a self-concept. For purposes of 
this paper, a self-concept is regarded 
as a relatively enduring aspect of per- 
sonality—a motive, attitude, or value 
—by means of which the individual 
relates himself to his social environ- 
ment. The term applies to the person’s 
‘ts of ideas about himself in relation 
to other persons 


s¢ 


PROCEDURE 

The problem was to find patterns of 
self-concepts useful in describing ado- 
lescents and young adults and to inte- 
grate the various theories that formu- 
late self-concepts in terms of child 
development. Since many existing sets 
of postulated self-concepts were origi- 
nally inferred on the basis of very 
early developmental periods, they 
may not be adequately descriptive of 
more mature levels of personality. The 
procedure, then, was to translate the 
hypothetical patterns of self-concepts 
offered by a variety of theorists into 
test items, to administer the test to 
groups of adolescent and young adult 
subjects, and to revise the list of hypo- 
thetical patterns of self-conceptualiza- 
tion on the basis of intercorrelation of 
test items. The resulting 
concepts were then ranked on the ba- 
sis of maturity ratings provided by 


sets of self- 
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groups of graduate students specializ- 
ing in developmental psychology. 

Since the results of any statistical 
analysis of test items depend in part 
on the nature of the items selected for 
analysis, an effort to minimize this 
limitation was made by including 
items based on a variety of theoretical 
viewpoints. Table 1 indicates the pos- 
tulated patterns of self-concepts for 
which items were devised and lists a 
sample item for each category. Items 
were based on the following theoretical 
formulations: (a) the empirical selves 
hypothesized by Sarbin (1952), (5) 
the psycho-social stages stated by 
Erikson (1960), (c) the character 
types described by Freud (1933), (d) 
the personality patterns postulated by 
Fromm (1947), and (e) the interper- 
sonal attitudes developed by Horney 
(1945). 


Construction of the Testing Instru- 
ment 


The test originated with a cluster 
analysis, using the technique described 
by Tryon (1939), applied to Sarbin’s 
five empirical selves. The author con- 
structed 135 items representing self- 
concepts postulated by Sarbin. Five 
graduate students specializing in per- 
sonality theory were asked to classify 
each item into the category it was sup- 
posed to measure. All five judges cor- 
rectly classified 110 items, which then 
were administered to a group of 100 
high school students. 

Four patterns of self-concepts 
emerged as a result of the cluster 
analysis. Sarbin’s first three empirical 
re highly intercorrelated and 


‘ 
< 


selves we 
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TABLE 1 
Tue PostuLaTep PATTERNS OF Se.r-Concerts ON Wuicu Test Irems Were Basep 


Personality 


Theorist Hypothesized Self-Concept 


Erikson | Infancy (Trust vs. Mistrust) 

Early Childhood (Autonomy vs. 
Shame and Doubt) 

Play Age (Initiative vs. Guilt) 

School Age (Industry vs. In 
feriority) 

Adolescence (Identity vs 
tity Diffusion) 

Young Adulthood (Intimacy vs. 
Isolation) 

Adulthood (Generativity vs 
Self-Absorption) 

Senescence (Integrity vs 
gust) 


Iden 


Dis 


Oral Character 
Anal Character 
Genital Character 


Freud 


Receptive Character 
Exploitative Character 
Hoarding Character 


Fromm 


Marketing Character 
Productive Character 


Compliant (Moving Toward) 
Detached (Moving Away) 
Aggressive (Moving Against) 


Horney 


Somatic Self 
Receptor-Effector Self 
Primitive-Construed Self 
Introjecting-Extrojecting Self 


Sarbin 


Social Self 
* Items were selected randomly for illustration 


were labeled the Somatic-Primitive 
Self. Items frum Sarbin’s fifth empiri- 
cal self had a high negative correlation 
with the first cluster and were called 
the Inner-Controlled Self. Sarbin’s 
fourth empirical self split into two 
sets of items. One cluster was labeled 
the Submissive-Dependent Self, while 
the other was tentatively named the 
Socially Integrated Self. These labels 
were assigned each cluster by con- 
sidering apparent logical relationships 
among items. 

Items representing a wider variety 
of theories were then added. The au- 


Example of Item* 
Most persons can be trusted 
I prefer to do things for myself. 


I take the lead in getting friends together 
I really enjoy working 


I usually stick to my own ideas even when 
friends disagree 

When feeling blue I try to find someone who 
is cheerful 

I wish I could discover something that would 
benefit future generations 

I try to find my faults and correct them. 


I look on the bright side of things 
I tend to save my money 
I love humanity in general. 


I prefer letting others make plans. 

I want to win when pitted against others 

If buying a car, I would be most interested 
in its economy. 

It is important to always please others. 

Friends say I am creative and original 

I enjoy just being with people 

I prefer being alone 

I often object to another’s ideas 

My body has greatly influenced me. 

I can’t wait to eat when hungry 

I let off steam when angry 

I usually do the expected thing to avoid dis 
approval of others 

If I cheated on a test, I would feel so guilty 
I couldn’t stand it 


thor constructed 250 items based on 
the theories of Erikson, Freud, 
Fromm, and Horney. The judges were 
again asked to classify each new item 
into the category or categories it pre- 
sumably measured, and the 225 items 
on which there was 100% agreement 
were administered to a second group 
of 100 high school students. A biserial 
coefficient of correlation was computed 
to show the relationship of each item 
to the total score of the four existing 
clusters. Items were assigned to the 
ciuster with which they had the high- 
est correlation. 
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All items representing Horney’s 
compliant orientation and many items 
describing Fromm’s receptive and 
marketing characters were added to 
the test measuring the Submissive- 
Dependent Self. A large number of 
items were added to the test measuring 
the Inner-Controlled Self from those 
representing Freud’s anal character, 
Fromm’s hoarding type, and the prob- 
lems listed by Erikson under school 
age, adolescence, adulthood, and se- 
nescence. The cluster labeled Socially 
Integrated Self absorbed many items 
representing Freud's oral and genital 
characters, Fromm’s productive char- 
acter, and the problems stated by 
Erikson under adulthood and senes- 
cence. Inspection of the items added 
to this cluster suggested a similarity 
to the self-actualizing personality de- 
scribed by Maslow (1954), and the 
cluster was renamed the Integrative- 
Actualizing Self. A set of items was 
found to have a high negative correla- 
tion with the Submissive-Dependent 
Self and was labeled the Outer-Con- 
trolling Self. This new pattern of self- 
concepts was composed largely of 
items representing Horney’s aggres- 
sive orientation, although it also con- 
tained items measuring the problems 
described by Erikson as typical of 


early childhood, the play age and the 


school age. Another group of items had 
a high negative correlation with the 
Integrative-Actualizing Self and was 


named the Detached-Independent 
Self. It was composed of items meas- 
uring Horney’s detached orientation 
and the problems outlined by Erikson 
with regard to the periods of infancy, 
early childhood, and young adulthood. 

Table 2 indicates relatively high 
negative correlations between certain 
of the six resulting patterns of self- 
concepts. Each pair of clusters with 
high negative correlations described 
contrasting _self-concepts. Hence 
forced-choice items were developed in 
which items from negatively corre- 
lated clusters were combined as al- 
ternative choices in a single question. 
Subtest 1 measured the Somatic-Prim- 
itive Self and the Inner-Controlled 
Self. Subtest 2 measured the Submis- 
sive-Dependent Self and the Outer- 
Controlling Self. Subtest 3 measured 
the Detached-Independent Self and 
the Integrative-Actualizing Self. Sam- 
ple forced-choice items from each sub- 
test are presented in Table 3. 

The use of forced-choice items of- 
fered several advantages. It resulted 
in a 50% reduction in the number of 
answers to be scored on each answer 
sheet. Once a score was obtained for 
a given cluster, the score for its nega- 
tively correlated counterpart could be 
computed simply by subtracting the 
first score from the maximum attain- 
able score. Anastasi (1954) points out 
that this testing technique provides 
changing alternatives and thus avoids 


TABLE 2 
INTERCORRELATIONS AMONG SELF-PATTERNS 


Integrative 
Actualizing 
Self 


Inner 
Controlled 
Self 


Submissive Detached Outer 
Dependent Independ Controlling 
Self ent Self Self 


| 
| 
| 


Somatic-Primitive Self —.17 10 : — .83 —.12 
Submissive-Dependent Self 10 18 — .08 
Detached-Independent Self — .78 
Outer-Controlling Self —.19 11 
Inner-Controlled Self 13 
Integrative-Actualizing Self 





Subtest 


1 


(A) Inner-Controlled 
Self 


(B) Somatic-Primi 
tive Self 


(A) Outer-Control- 
ling Self 


(B) Submissive-De 
pendent Self 


3 


(A) Integrative-Ac- 
tualizing Self 


(B) Detached-Inde- 
dependent Self 
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TABLE 3 


SamMPp_LeE ITEMS FROM THE THREE SUBTESTS 


Examples of Test Items* 


(A) If I won $1,000, I would be 


more likely to save most of 
it for future needs. 


I would prefer having par 
ents, teachers, or employers 
think well of me. 


My family has had a greater 
influence on me. 

I say little when angry. 

I am sure most policemen 
are helpful. 

I like giving directions to 
others 


I want to be considered 
strong by others 


I would like to be thought of 
as an important person in 
my community. 


) I often raise objections to 


another’s ideas. 


My former teachers would 
be more likely to call me a 
leader. 


I often enjoy change and 
rather look forward to try 
ing new things and meeting 
new people. 


One of my best features is 
that I like people 


I realize human nature isn’t 
perfect, but I can accept it 
and even like it as it is 


I am left with a feeling of 
strength upon seeing or 
hearing something truly 
beautiful. 


) I am usually optimistic and 


enthusiastic and seldom 
lonely and depressed 


* Items were selected randomly for illustration 


B) If I won $1,000, I would be 


more likely to spend most of 
it now on things I need to 
have a good time. 


I would oom just taking it 
easy and enjoying life 


My body and its feelings 
have had a greater influence 
on me. 


) I let off steam when angry. 


) It is likely too many police- 


men try to show their 
authority 


I prefer following directions 
given by others 


I prefer being thought of as 
kind and sympathetic. 


I wouldn’t care to be con 
sidered an important per- 
son 


) I usually accept the ideas of 


others without being crit 
ical 


) My former teachers would 


be more likely to call me a 
follower. 


I dislike change and tend to 
feel uncomfortable in new 
situations 


One of my best features is 
that I don’t let feelings in 
fluence my judgment 


I find it hard to accept hu 
man nature as it is 


I am not too impressed by 
art or music, although these 
things seem beautiful to 
others 


There are quite a few times 
when I feel alone and afraid 
and just about the whole 
world seems unfriendly. 
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the tendency toward a response set 
characteristic of constant-alternative, 
true-false items. 

Forced-choice alternatives were se- 
lected from items which seemed to 
logically fit together. However, items 
chosen by over 90% or fewer than 
10% of the tutal group were elimi- 
nated, since they seemed to reflect ex- 
tremes of social approval and disap- 
proval. New forced-choice items, 50 
for each subtest, were added to exist- 
ing items and the revised test admin- 
istered to a third group of 100 high 
school students. A biserial coefficient 
of correlation was computed showing 
the relationship of each item to the 
total score. Items correlating less than 
.20 with the total subtest were elimi- 
nated. The new forced-choice form 
was then administered to a group of 
300 undergraduate students at the 
University of California, each item 
correlated with the total score, and 
additional items eliminated. 

Validity of the subtests was ap- 
praised by asking high school counse- 
lors to rate students for each subtest 
on the basis of an adjective checklist 
describing characteristics appropriate 
for the subtest. For example, descrip- 
tive terms applicable to the first sub- 
test included the following words: con- 
scientious, controlled, conforming. 
Subjects with ratings in the upper and 
lower 27% of the group based on total 
number of adjectives checked for each 
subtest were then compared for mean 
scores on the subtest and ¢t ratios com- 
puted. The differences between means 
were all significant at less than the 
.01 level of confidence. Similar results 
were obtained in a second validation 
study. Corrected split-half reliability 
coefficients were above .80 for groups 
from the tenth grade to college under- 
graduates. 


‘A copy of the testing instrument has 
been deposited with the American Docu- 
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Five graduate students at the Uni- 
versity of California were asked to 
rank each cluster in terms of relative 
maturity as inferred on the basis of 
their knowledge of developmental psy- 
chology. Each judge had completed at 
least two advanced undergraduate 
courses and graduate research in this 
area. A second group of five graduate 
students with similar qualifications 
but from a different institution also 
ranked the six patterns of self-con- 
cepts. While both groups agreed on the 
rank order, agreement was less con- 
sistent for the relative position of the 
Detached-Independent Self and the 
Outer-Controlling Self than for the 
other levels of self-conceptualization. 
There was 100% agreement on the 
Somatic-Primitive Self; 90% each on 
the Dependent-Submissive Self, the 
Inner-Controlled Self, and the Inte- 
grative-Actualizing Self; 70% on the 
Detached-Independent Self; and 60% 
on the Outer-Controlling Self. 

The six resulting self-patterns, listed 
from the one rated least to the one 
ranked most mature, may be described 
as follows: (a) the Somatic-Primitive 
Self involves inability to postpone 
need satisfaction and failure to iden- 
tify with authority figures, (b) the 
Submissive-Dependent Self involves 
avoidance of disapproval by submit- 
ting to others, (c) the Detached-Inde- 
pendent Self involves avoidance of 
interpersonal relations and _ situa- 
tions likely to arouse emotion, (d) 
the Outer-Controlling Self involves 
achievement of social status through 
manipulation of the external world in 
socially approved ways, (e) the Inner- 
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Controlled Self involves development 
of inner controls through internaliza- 
tion of external social norms, (f) the 
Integrative-Actualizing Self involves 
acceptance of oneself and others and 
a tendency toward increased creativ- 
ity and productivity. 


RESULTS 


A Comparison of High School and 
College Groups 


The final form of the test was uti- 
lized with a sample of high school and 
college students. The high school stu- 
dents were from a large urban high 
school in California and were ran- 
domly selected within categories to 
constitute a stratified sample propor- 
tionate to the college group regarding 
racial and socioeconomic classifica- 
tion. The college students consisted of 
undergraduates attending the Univer- 
sity of California at Berkeley, and 
the sample was selected to be repre- 
sentative of this campus with regard 
to fields of study. Separate results are 
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reported for males and females in both 
groups and for college preparatory and 


noncollege preparatory high school 
students. The college preparatory 
group consisted of students taking 
courses which will enable them to at- 
tend a private or state college, a pri- 
vate or state university, or a junior 
college. The college sample constitutes 
a group selected from a sample similar 
to the college preparatory group on 
the basis of academic achievement in 
high school. Further details regarding 
these groups are presented in Table 4. 

Means for high school and college 
groups are indicated in Table 5. Sepa- 
rate means are not given for each age 
group within the high school or college 
groups, since no statistically signifi- 
cant differences were found with re- 
gard to such age levels. Since each 
subtest measures two negatively cor- 
related self-levels, one rated as rela- 
tively more mature than the other, 
the means presented in Table 5 are for 
the self-pattern with the higher ma- 
turity ranking. For example, the 


TABLE 4 


CoMPoOSsITION oF Groups USED IN THE StTupy 


Characteristics 
Males 66 
Females 49 


Median Age (Males) 22 yrs.-1 mo 
10 mo 


Median Age (Females) 21 yrs.- 


College Sample 


High School 
College Preparatory 


High School: Noncol 
lege Preparatory 


40 100 
45 135 


16 yrs.-10 mo. 
16 yrs.-9 mo. 


11 mo 
1] mo 


16 yrs 
16 yrs 


86% 


Caucasian 86% : 
Negro ¢ 8% 8% 
Other 6% 6% 


9Q°7 9Q07 
28 c 23 
eo Ro0,7 
§29, . 52% 


20% 20% 


Upper Socioeconomic Status* 
Middle Socioeconomic Status* 
Lower Socioeconomic Status* 


First Year 
Second Year 
Third Year 
Fourth Year 


® Based on father’s occupation 
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TABLE 5 
A Comparison oF Hicu ScHooLt ano CoLiece Groups 


Males 
High School, Noncollege 
High School, College 
College 


Preparatory 


t (High School, Noncollege vs. High 


School, College Preparatory 


t (High School, College Preparatory 
vs. College) 


Females 

High School, Noncollege 

High Schoool, College Preparatory 
College 


t (High School, Noncecllege vs. High 


School, College Preparatory) 


t (High School, College Preparatory 
vs. College) 


Males-Females Compared 
t (High School, Noncollege Females 
vs. High School, Noncollege Males 


t (High School, College Preparatory 
Females vs. High School, College 
Preparatory Males) 


t (College Females vs. College Males 


** Significant at the .01 level of confidence or less 


means given under Subtest 1 are for 
the Inner-Controlled Self, and the 
means for the Somatic-Primitive Self 
ean be determined by subtracting the 
stated means from the maximum pos- 
sible score of 124 points. Means pre- 
sented under Subtest 2 apply to the 
Outer-Controlling Self, and means for 
the Submissive-Dependent Self can be 
determined by subtracting the stated 
means from 103, the highest attainable 
score for this subtest. Means listed for 
Subtest 3 represent the Integrative- 
Actualizing Self, and means for the 
Detached-Independent Self may be 


Subtest 1 Subtest 2 Subtest 3 


SD Mf SD 


16.3 


25.8 
16.2 


50.4 11.6 
58.4 13.9 
66.7 11.9 


1.81 


3.18** 


25 3.44** 


20.4 
19.1 
16.7 


77.5 14.3 
86.6 16.0 
71.5 19.2 


41.0 
50.1 
55.9 


15.1 
14.5 
14.4 


46 3.65** 


computed by subtracting the stated 
means from the maximum possible 
score of 120 points 

Although high school boys preparing 
for college tended to score higher than 
those not preparing for college on all 
three self-levels rated most mature, 
the difference was significant at less 
than the .01 level only for the Outer- 
Controlling Self. Although college 
males scored higher than high school 
college preparatory males on all three 
mature levels of self-conceptualiza- 
tion, differences were slight and not 
significant at an acceptable level ex- 
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cept for the Outer-Controlling Self, 
which involved a difference significant 
at less than the .01 level. 

High school girls preparing for col- 
lege scored higher than noncollege pre- 
paratory females on the three self- 
levels with highest maturity rankings. 
Differences were significant at less 
than the .02 level for the Inner-Con- 
trolled Self, at less than the .01 level 
for the Outer-Controlling Self, and at 
less than the .05 level for the Inte- 
grative-Actualizing Self. Means repre- 
senting the Outer-Controlling Self 
were higher for college women than 
college preparatory high school girls, 
and the difference was significant at 
about the .01 level. However, female 
college students obtained a lower mean 
than college preparatory high school 
girls on the test measuring the Inner- 
Controlled Self, although the differ- 
ence was not statistically significant 
at an acceptable level. The college 
females also had a lower mean than 


college preparatory females on the 
test measuring the Integrative-Actual- 
izing Self, and the difference was large 
and significant at less than the .01 
level. 

Both groups of high school females 


scored higher than corresponding 
groups of males on the test measuring 
the Inner-Controlled Self, while males 
scored slightly higher than females 
on this test at the college level. How- 
ever, these differences were neither 
large nor statistically significant. All 
male groups scored higher than cor- 
responding female groups on the test 
measuring the Outer-Controlling Self, 
and ali differences were relatively 
large and significant at less than the 
.01 level. High school girls had higher 
means than high school boys for the 
Integrative-Actualizing Self. The dif- 
ference between means on this test 
was significant at almost the .02 level 
for noncollege preparatory students 
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and at less than the .01 level for col- 
lege preparatory students. The trend 
was reversed at the college level, and 
college men tended to score higher 
than college women on this test, al- 
though the difference was not statis- 
tically significant. 


DISCUSSION 


It is to be expected that college stu- 
dents would tend to score higher than 
high school students on tests measur- 
ing mature self-levels as a result both 
of college experience and selection of 
more mature students for admission to 
the university. This hypothesis tends 
to be confirmed for males with regard 
to all three more mature self-levels, 
although differences are large and sig- 
nificant at less than the .01 level only 
for the Outer-Controlling Self. Fur- 
ther, females do not seem to follow 
this trend in relation to the Inner- 
Controlled Self and the Integrative- 
Actualizing Self. However, these rela- 
tively low scores of University of 
California females indicate the female 
group is more highly select than the 
college males used in this study. Sta- 
tistics for the high school district 
show that about 1.5 times more fe- 
males than males from this area enter 
private colleges rather than attend 
public universities. The emphasis on 
academic achievement as an entrance 
requirement at the university possibly 
results in selection of more competitive 
individuals and would account in part 
for the relatively high scores of both 
male and female college groups on the 
test measuring the Outer-Controlling 
Self. The tendency for males consist- 
ently to score higher than females on 
the test measuring the Outer-Control- 
ling Self is to be expected in view of 
child training practices in our society 
which from early childhood permit 
males greater freedom than females in 
exploring and manipulating their en- 
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vironments. Since females mature both 
physically and socially at an earlier 
age than males, it is not surprising to 
find that high school females tend to 
score higher than males on the two 
self-patterns with the highest maturity 
rankings, while the trend is reversed 
and males score higher than females 
at the university level. 

The findings for high school groups 
indicate that college preparatory stu- 
dents tend to have more mature self- 
concepts than noncollege preparatory 
students. The large and statistically 
significant differences obtained be- 
tween college preparatory and non- 
college preparatory students on the 
test measuring the Outer-Controlling 
Self suggest that college preparatory 
students show greater drive to attain 
status long before attending college. 
If subsequent research confirms dif- 
ferences in self-concepts related to 
college attendance and preparation for 
college, it becomes important to con- 
sider personality factors along with 
academic achievement as a basis for 
predicting future success among col- 
lege applicants. 

Since the results are likely to vary 
with the theoretical viewpoints repre- 
sented in the test items analyzed, the 
self-patterns described in this study 
should not be regarded as a final list 
Further, the six self-levels should not 
be interpreted as rigid categories into 
which all persons may be classified on 
an all-or-nothing basis. Every subject 
checked at least some items for every 
one of the six self-patterns. Hence it 
seems safe to assume that the more 
immature levels continue into at least 


early adulthood to some extent in all 
individuals. 
SUMMARY 
[tems measuring self-concepts were 
constructed representing the theories 
of Sarbin, Freud, Erikson, Horney, 
and Fromm. A cluster analysis yielded 
six self-patterns, which, ranked from 
least to most mature on the basis of 
ratings by graduate students in 
psychology, were: (a) the Somatic- 
Primitive Self, (b) the Submis- 
sive-Dependent Self, (c) the De- 
tached-Independent Self, (d) the 
Outer-Controlling Self, (e) the Inner- 
Controlled Self, and (f) the Integra- 
tive-Actualizating Self. Significant 
differences in means on tests measur- 
ing various self-levels were found for 
contrasting groups of males and fe- 
males, college preparatory and non- 
college preparatory high school stu- 
dents, and college and high school 
students. 
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According to Spence’s (1956) theory 
the effect of motivational or drive 
level on performance depends on the 
complexity of the task. In a “simple” 
task, in which the correct response 
tendency is stronger than competing 


response tendencies, subjects with 


higher drive perform at higher levels 
than subjects with lower drive; but in 
a “complex” task, in which the correct 
response tendency is weaker than com- 
peting response tendencies, they per- 


form at lower levels than subjects 
with low drive. These effects depend 
on the energizing property of drive. 
Castaneda (1956) has suggested that 
the inverse relationship between drive 
level and performance may also be 
obtained in simple tasks, such as a 
reaction time situation, in which the 
correct response is mediated by im- 
plicit verbal responses. Theoretically, 
a drive produces “drive stimuli” which 
may be conditioned to responses. If 
these drive-produced responses inter- 
fere with the implicit verbal responses 
which mediate the instrumental act, 
the task becomes a complex one and 
there will be more interference under 
high drive, since the drive-produced 
responses have a greater probability 
of occurrence, than under low drive. 
The Children’s Manifest Anxiety 
Seale (CMAS) was designed by Cas- 
taneda, McCandless, and Palermo 
(1956) as a measure of drive in chil- 
dren. Relationships have been demon- 
strated between CMAS scores and 
school achievement (McCandless & 
Castaneda, 1956) and performance on 
simple and complex learning tasks 
(Castaneda, Palermo, & McCand- 


less, 1956; Palermo, Castaneda, & 
McCandless, 1956) which indicate 
that children with high CMAS scores 
are superior to low scoring subjects 
on simple tasks and inferior on com- 
plex tasks, in line with the interpreta- 
tion of CMAS scores as indicants of 
drive level. 

It has been suggested that the in- 
verse relationship between CMAS 
scores and performance on complex 
tasks may result from the negative 
correlation between CMAS scores and 
intelligence which has been found 
(.jafner & Kaplan, 1959; McCandless 
& Castaneda, 1956; Phillips, King, & 
McGuire, 1959). Phillips et al. (1959) 
reported that when the effects of in- 
telligence were partialed out, there 
was no relationship between CMAS 
scores and performance on a battery 
of psychometric tests differing in 
“complexity.” 

The present study was designed to 
provide additional evidence regarding 
the relationships among manifest anx- 
iety, intelligence, and performance. 
An arithmetic test was given under a 
time limit, and it was assumed that 
for fourth and sixth grade school chil- 
dren the test would be more nearly a 
speed test than a power test, i.e., that 
it would be a simple task in which 
speed was emphasized (as in the re- 
action time situation). It was further 
assumed that the motor responses 
(writing the answers) would be ver- 
bally mediated, and that manifest 
anxiety would produce responses 
which would interfere with the medi- 
ators (i.e., the symbolic processes). 
Therefore, the inverse relationship be- 
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tween manifest anxiety and perform- 
ance was predicted. 
METHOD 

Subjects. The subjects were 539 fourth 
and sixth grade school children from the 
Williamsville, New York, school district’ 
The data of an additional 85 subjects were 
54 subjects missed one of the 
available for 31 


eliminated 
and IQs were not 
subje cts 
Tests and Procedure 

given the CMAS and later an 
arithmetic test consisting of 40 addition 
problems, each with four three-digit num- 
bers. The arithmetic test had a 13-minute 
time limit. Both tests were administered by 
the teachers to their regular classes, using 
standard instructions. Scores on the Primary 
Mental Abilities Test, which is routinely 
administered in the third and sixth grades, 
were obtained from school records 


tests, 


The subjects were 


one week 


RESULTS 

Table 1 presents mean scores on the 
variables, and provides further infor- 
mation about the sample and the diffi- 
culty level of the achievement test. 
(Difficulty level is not necessarily re- 
lated to “complexity” of the test, since 
the correct response may be dominant 
in the response hierarchy but have a 
low probability of occurrence and 
therefore a long latency. Under these 
conditions low would result 
the time limit is relatively 


scores 
when 
short.) 

Correlations the 
are presented in Table 2.? 


variables 
Manifest 


among 
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*Castaneda (1956) suggested that 
may be two kinds of anxiety, “verbal” and 
“nonverbal” or “somatic.” The former should 
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TABLE 1 


Mean IQ, CMAS Scores, anp 
ARITHMETIC Test Scores 


Group 


Measure Fourth Grade Sixth Grade 


Females) Males Females Males 


N 139 144 118 /|138 
IQ 112.4) 108.6) 112.3/108 
Anxiety Score 15.8 14.4, 14.9) 13.; 
Lie Score 5.0 4.3 3.4, 3. 
Number Right 11.8; 10.9) 21.9) 20 

on Arithmetic 

Test 
Number Wrong 

on Arithmetic 

Test 


anxiety was negatively correlated with 
the number of correct answers on the 
achievement test, though the correla- 
tion was not significant for fourth 
grade males. To provide further in- 
formation about the relationship be- 
tween manifest anxiety and achieve- 
ment, the subjects of each sex in each 
grade were divided into six subgroups 
on the basis of CMAS scores, and their 
achievement test scores were com- 
pared. The main effect of Anxiety 
Levels was significant (P= 6.73; df = 
5,464; p < .001), but this factor did 
not interact significantly with grade 
or sex, indicating that there was a sig- 
nificant relationship between manifest 


produce responses which interfere with medi- 
ators in the present type of task, but the 


latter should not. Verbal and somatic sub- 
were constructed from the CMAS, 
and it was predicted that the correlations 
with achievement would be negative for the 
former and positive for the latter, 
subjects with high drive should be superior 
to subjects with low drive unless the drive 
produces responses which interfere with the 
The average correlations with 
achievement were —.20 for verbal anxiety 
and —.15 for somatic anxiety. The failure 
to confirm the prediction may reflect a lack 
of validity of the a flaw in the 
theoretical analysis 


sca les 


since 


mediators 


subscales or 
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TABLE 2 
PEARSON Propuct-MoMENT CORRELATIONS 
amMona CMAS Scores, IQ, anp Num- 
BER R1GHT ON ACHIEVEMENT TEST 


Group 


Variables 


Sixth Grade 
Correlated 


Fourth Grade 


Males 


Females| Males | Females 


.46°** 67°** 


IQxXR 58°°° .48°°" 
Anxiety X R — .33°°* 15 — 22° 19° 
Lie X R -.1l —,22°°° |— g3%°° 10 
33°°° 01 18° 03 


35ee* |—.32%¢* |—.17° 


Anxiety X IQ 
Lie X IQ 14 


Anxiety X Lie 00 —.24°** |—.05 — .23°°° 


Note.—"*R” 
ment test. 
*p< .05 
** p< .025 
see p < 01 


refers to Number Right on the achieve- 


TABLE 3 
PARTIAL CORRELATIONS BETWEEN NUMBER 
Ricgut AND MANIFEST ANXIETY, WITH 
IQ PaRTIALED OUT AND WITH LIE 
Score PaRTIALED OUT 


Group 


Variable 


‘ Sixth G 
Partialed Out ixth Grade 


Fourth Grade 


Females | Males Females| Ma 


IQ .26 20 14 
Lie Score 38 .22 25 


anxiety and performance on _ the 
achievement test, but the trends were 
not significantly different in the dif- 
ferent sexes or grades. The eta for the 
combined sexes and grades was about 
.21, which was about the same as the 
mean of the Pearson correlation co- 
efficients between anxiety and achieve- 
ment (cf. Table 2). Therefore, it was 
concluded that the relationship be- 
tween anxiety and achievement is 
negative and linear. 

Examination of Table 2 shows that 
manifest anxiety was more strongly 
correlated with achievement test 
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scores than with IQ. Table 3 presents 
partial correlations between anxiety 
and achievement, with IQ partialed 
out, and with lie score partialed out. 
Partialing out IQ tended to reduce the 
correlations for females by about .07, 
and to increase the correlations for 
males by about .04. Partialing out the 
lie score increased the correlations an 
average of about .03. 

The multiple correlations for pre- 
dicting performance from anxiety and 
IQ were about .04 higher than the 
correlations for IQ alone; and the 
combination of anxiety and lie score 
improved prediction, compared with 
anxiety alone, by an average of about 
.07. The use of anxiety, IQ, and lie 
score improved prediction, compared 
with IQ alone, by an average of about 
.04, and compared with anxiety and 
IQ, by only about .01. 

The lie score was significantly nega- 
tively correlated with achievement in 
fourth grade males and sixth grade fe- 
males. Partialing out IQ reduced the 
correlations to .03 and —.19, respec- 
tively. 


DISCUSSION 


The data indicate that the relation- 
ship between manifest anxiety and 
performance on a task requiring medi- 
ation is monotonic and negative, but 
that although statistically significant, 
it is not a strong relationship. Par- 
tialing out IQ had little effect on the 
correlations, but on the other hand the 
combination of manifest anxiety with 
IQ did not appreciably increase the 
accuracy of predicting performance 
over that for prediction on the basis of 
IQ alone. Therefore, it must be con- 
cluded that although the relationship 
between manifest anxiety and per- 
formance is not a result of the 
relationship between anxiety and in- 
telligence, manifest anxiety has rela- 
tively little influence on scores on an 
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achievement test of the type used in 
the present study. 

The lie scale does not seem to serve 
any useful purpose as far as prediction 
of performance on the present type of 
task is concerned, though it does ap- 
pear to measure a tendency to falsify 
answers, at least in males. 

SUMMARY 

Fourth and sixth grade children 
were given the Children’s Manifest 
Anxiety Scale and an arithmetic 
achievement test, consisting of 40 ad- 
dition problems, which was given with 
a time limit. It was found that mani- 
fest anxiety was inversely and mono- 
tonically related to the number of cor- 
rect responses on the achievement test. 
Partialing out 1Q had little effect on 
the correlations between manifest anx- 
iety and achievement, but predictions 
of achievement were not appreciably 
improved by the combination of mani- 
fest anxiety with IQ. 

REFERENCES 


CastanepA, A. Reaction time and response 


amplitude as a function of anxiety and 


stimulus intensity. J. abnorm. soc. Psy- 
chol., 1956, 53, 225-228 

CasTanepA, A., McCanoiess, B. R., & 
Patermo, D. S. The children’s form of 
the Manifest Anxiety Scale. Child De- 
velpm., 1956, 27, 317-326. 

CasTanepa, A., Patermo, D. S., & McCanp- 
Less, B. R. Complex learning and per- 
formance as a function of anxiety in 
children and task difficulty. Child De- 
velpm., 1956, 27, 327-332 

Harner, A. J.. & Kapitan, A. M. Children’s 
manifest anxiety and intelligence. Child 
Develpm., 1959, 30, 269-271 

McCanouess, B. R., & Castanepa, A. Anxi- 
ety in children, school achievement, and 
intelligence. Child Develpm., 1956, 27, 
379-382 

Patermo, D. S., Castanepa, A.. & McCanp- 
Less, B. R. The relationship of anxiety 
in children to performance in a complex 
learning task. Child Develpm., 1956, 27, 
333-337 

Pui.ups, B. N., Kina, F 


Studies on anxiety 


J., & McGuire, C 

I Anxiety and per- 
formance on psychometric tests vary- 
ing in complexity. Child Develpm., 1959, 
30, 253-259 

Spence, K. W 
ditioning. New 
Press, 1956 


Beha wr theory and con- 
Haven: Yale Univer 


Received July 25, 1960) 





Journal of Educational Psychology 
1961, Vol. 52, No. 3, 136-147 


CREATIVE AND ACADEMIC PERFORMANCE 
AMONG TALENTED ADOLESCENTS' 


JOHN L 


HOLLAND* 


National Merit Scholarship Corporation, Evanston, Illinois 


The need to understand the nature 
of academic achievement and creative 
behavior is pressing; such knowledge 
is vital for the proper development of 
educational practice, the administra- 
tion of scholarship and fellowship pro- 
grams, and the fostering of talented 
behavior generally. Unless attempts 
to encourage the development of crea- 
tive talent rest on valid assumptions 
about the nature of academic and 
creative behavior, such efforts will 
have little useful influence. 

The present study is one of several 
investigations planned to explore the 
nature of academic achievement and 
creative behavior in adolescents and 
young adults (Holland, 1959a, 1959b, 
1960a). The earlier studies were con- 
cerned primarily with academic per- 
formance. This study tests a large 
number of hypotheses about variables 
which are often assumed to be asso- 
ciated with both academic and crea- 
tive achievement—aptitude _ scores, 
self and teacher ratings, originality 
measures, parental attitudes and val- 
ues, vocational interests and aspira- 
tions, and background information. 
Most of the variables were used to test 
a limited number of hypotheses; a few 
were included for exploratory pur- 
poses. The hypotheses about the na- 
ture of the academic achiever were 
derived in part from an extensive lit- 

‘This study was partially supported by 
research grants from the National Science 
Foundation and the Old Dominion Founda- 
tion 

*I am indebted to the following staff 
members for their skillful assistance in all 
phases of this project: Virginia Chalmers, 
Laura Kent, Donald Thistlethwaite, and 
Elizabeth van Laer 


erature which suggests that the stu- 
dent who gets good grades in high 
school is bright, persistent, conform- 
ing, self-controlled, responsible, seri- 
ous, and rated high by his teachers 
(d’Heurle, Mellinger, & Haggard, 
1959; Gough, 1953; Holland, 1959a, 
1959b). Drews and Teahan (1957) in- 
dicate that the academic achiever 
tends to have a somewhat authoritar- 
ian mother. Several recent reports 
(Holland, 1960a; MacKinnon, 1959) 
imply also that good grades in high 
school and college may be either un- 


related to, or negatively correlated 


with, potential for creative perform- 
ance. Taken together, these findings 
have somewhat consistent implications 
about the academic achiever and his 
parents’ attitudes and values. The hy- 


potheses derived from the literature 
and tested here are summarized as fol- 
lows. 

1. Outstanding academic achieve- 
ment—High School Rank (HSR)— 
will be positively associated with high 
scores on the Scholastic Aptitude Test 
(Math and Verbal factors) (SAT- 
M and SAT-V), and on the Mastery, 
Deferred Gratification, and Control 
scales; with high Self-Ratings of 
Drive to Achieve and Perseverance; 
with high Teacher Ratings of Matu- 
rity, Popularity, and Social Leader- 
ship; with Fathers’ Values of Good 
Student; and with mothers’ authori- 
tarian attitudes as measured by the 
Parental Attitude Research Inven- 
tory (PARI). 

2. Outstanding academic achieve- 
ment will be associated with low scores 
on measures of creativity and origi- 
nality (Differential Reaction Sched- 
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ule, Complexity-Simplicity, Independ- 
ence of Judgment, and Barron 
Originality scales) and with low self- 
evaluations. 

The hypotheses about the nature of 
the creative student were drawn prin- 
cipally from the work of Barron 
(1953a, 1953b), Gough (1957a), and 
MacKinnon (1959), which depicts the 
creative person as independent, com- 
plex in outlook, curious, self-assured, 
intellectual, interested in science and 
art, and generally effective. This char- 
acterization implies also a more per- 
missive parental background which 
encourages independence and the ex- 
ploration of self and environment. The 
hypotheses derived from this literature 
are summarized as follows. 

1. Creative performance (winning 
public competitions which demand 


creativity) will be positively associ- 
ated with high scores on measures of 
creativity and originality (Differential 
Reaction Schedule, Complexity-Sim- 
plicity, Independence of Judgment, 


and Barron Originality scales), and 
on the Initiative and Self-Assurance 
scales; with high Self-Ratings of 
Originality, Independence, and Per- 
severance; with Fathers’ Values of 
Curious and Independent; and with 
mothers’ nonauthoritarian attitudes. 

2. Creative performance will have 
no correlation, or negative correla- 
tions, with good high school grades; 
with high Self-Ratings of Popularity; 
with high Teacher Ratings; and with 
Fathers’ Values of Dependable, Good 
Student, Happy and Well-Adjusted, 
and Popular. 


METHOD 


Student and Parent Sample 


The student and parent samples were ob- 
tained from a one-sixth random sample of 
National Merit Finalists (approximately 
9,868 high-scoring students by state from an 
initial pool of 478,991 high school juniors), 
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who were polled and tested by mail. An 
84% return was obtained, but incomplete 
information reduced the sample to 59%, 649 
boys and 345 girls, and their parents. The 
average aptitude level of these samples on 
the SAT were: For boys, SAT-V and 
SAT-M, 658.4 and 6979 with SDs of 568 
and 62.2, respectively. For girls, the SAT-V 
and SAT-M means are 659.2 and 635.4 with 
SDs of 606 and 703. 


Academic and Creative Performance 


The criterion of academic performance 
was high school grades (HSR) during the 
first 3 years of high school. The criteria of 
creative performance were derived from a 
checklist of accomplishments assumed to re- 
quire creative or original behavior. Creative 
performance is defined as a performance 
which is accorded public recognition through 


awards, prizes, or publication, and which may 


therefore be assumed to have exceptional 
cultural value. Because of the difficulty in 
arriving at a generally acceptable definition 
of “creativity,” these criteria should perhaps 
be regarded as either “notable scientific or 
artistic performance,” although we will refer 
to the criterion as “creative” performance 
hereafter to enhance readability. With this 
definition as a guide, a list of 20 achieve- 
ments at the high school level was derived 
by reviewing the secondary school achieve- 
ments of Finalists from previous years 
Items were divided by content into two 
Creative Science (5 items) and Cre- 
ative Arts (11 items). (Four of the original 
20 items were omitted because they ap- 
peared to be inadequate signs of creative be- 
havior.) The items on the two scales are 
shown below. Students were asked to check 
those which applied to them 


scales: 


Creative Science Scale 

Gave an original paper at a sci- 
entific meeting sponsored by a 
professional society. 
Won a prize or award in a sci- 
entific talent search. 
Constructed scientific apparatus 
on own initiative. 
Invented a patentable device. 
Had scientific paper published in 
a science journal. 

Item 3 does not meet the criteria of 


“public recognition” and “unusualness,” but 
in order to lengthen the scale, it was in- 
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cluded as a low-level sign of creative per- 
formance. Similarly, Item 4 depends on the 
student’s judgment, and may or may not be 
an accomplishment which has received pub- 
lic recognition. 
Creative Arts Scale 
Won one or more speech con- 
tests. 
Had poems, stories, or articles 
published in a public newspaper 
or magazine (not school paper) 
or in a state or national high 
school anthology. 
Won a prize or award in an art 
competition (sculpture, ceram- 
ics, painting, etc.). 
Received the highest rating in a 
state music contest. 
Received one of the highest rat- 
ings in a national music contest. 
Composed music which has been 
given at least one public per- 
formance. 
Arranged music for public per- 
formance. 
(not 
church-spon- 


Had minor roles in plays 


high school or 
sored). 

Had leads in high school or 
church-sponsored plays. 

Won literary award or prize for 
creative writing. 

Had cartoon published in public 
newspaper or magazine, etc. 
(not high school paper). 


For boys, the estimated reliabilities 
(Kuder-Richardson Formula 20) of the Arts 
and Science scales, respectively, are 36 and 
55. For girls, the reliabilities are 38 and 37. 
These low reliabilities may be attributed to 
the’brevity of the scales; they limit the level 
of correlation between the predictors and 
these criteria. The Arts and Science scales 
correlate with one another 15 and 09 for 
boys and girls, respectively. 


Predictors 


Students and parents were sent the fol- 
lowing inventories and scales. Students filled 
out: 

1. The Gough 


(1957b) Differential Re- 
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action Schedule (DRS), an inventory which 
was designed to predict originality and which 
contains the following scales: Intellectual 
Competence, Inquiringness, Cognitive Flexi- 
bility, Esthetic Sensitivity, Sense of Destiny, 
Total Score (sum of all scores), and Poten- 
tial Success (PIV), an index of general drive 
and ambition derived from a variety of In- 
stitute of Personality Assessment and Re- 
search (IPAR) studies of achievement and 
personal effectiveness 

2. The Complexity-Simplicity, Independ- 
ence of Judgment, and Originality scales 
from Barron’s (1952) Inventory of Personal 
Philosophy. Only 54 of the 150 items in the 
Originality scale were used. The Com- 
plexity-Simplicity scale consists of items 
from the original 900-item IPAR inventory, 
selected for their significant correlations 
with scores on the Barron-Welsh Art Scale 
in five different samples, four groups of 
college students and one of military officers 
The successive sample method was used for 
item selection; on cross-validation the final 
correlated .7 with the Figure Preference 
The Originality scale was developed 
out of MMPI-CPI pool by correlating 
each item with a composite score on four 
measures of originality (Guilford’s Unusual 
Consequences, and Plot Titles; and 
the IPAR Word Rearrangement test) in 
a sample of 343 military officers. It was cross- 
validated by correlating it with a composite 
of the three Guilford tests in a sample of 150 
undergraduates at the University of Cali- 
fornia? 

3. The Mastery scale, an 18-item scale 
derived from three items on Strodtbeck’s 
Value Scale (1958) 

4. The Deferred Gratification scale, for- 
merly called the Play scale, from the Na- 
tional Merit Student Survey (Holland, 
1960a ) 

5. The Vocational Preference Inventory 
(VPI), a short revision of the Holland Vo- 
cational Preference Inventory (Holland, 
1958) 

6. The Ghiselli Self-Description Inven- 
tory. Since the _ correlations between 
weighted and unweighted scale scores for the 
Initiative, Self-Assurance, and Occupational 
Level scales ranged from 89 to 96, the 
items of these scales were scored with unit 
weights rather than being weighted differ- 
entially 

7. Self-ratings on a four-point scale and 
a Self-Evaluation score based on the number 


s« vale 


scale 


*Frank Barron, personal communication, 
June 1960 
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of times a student rates himself above aver- 
age on 20 traits 

8. The Activities scale (CAS), 
a list of hobbies and activities assumed to 
demand original behavior. Teacher Ratings 
of Citizenship, Popularity, and Social 
Leadership were also available for each 
student, as well as SAT scores, level of de- 
gree sought, Birth Order, and a Breadth 
of Interest score based on the number of 
activities and interests checked from a list of 
47 items. 

Mothers filled out the PARI (Schaefer & 
Bell 1958), and 16 of the 23 five-item scales 
were used. Fathers gave information on 
family background and ranked nine goals 
and traits in the order in which they con- 
sidered them valuable for their children to 
possess 


Creative 


RESULTS 


Correlational analysis. The 75 pre- 
dictors and criteria were intercorre- 
lated (product-moment) and the com- 
plete 75 < 75 matrices for boys and 
girls, along with the means and stand- 
ard deviations, have been deposited 
with the ADI.* Tables 1 and 2 show 
only the correlations between the three 
criteria of academic and creative per- 
formance and the 72 predictive vari- 
ables. The influence of intelligence has 
been partialed out, using the SAT-M 
score as an estimate of intelligence for 
all three criteria, since the math score 
has higher correlations with the three 
criteria than does the verbal score. 
Generally, SAT-M has low correla- 
tions with the predictors. The largest 

* The following tables have been deposited 
with the American Documentation Institute: 
Tables A and B, Correlational matrices for 
boys and girls; Tables C and D, Means and 
standard deviations for boys and girls on 75 
variables; and Tables E and F, Daydreams 
about future occupations for students who 
are high and low in academic and creative 
performance. Order Document No. 6611 
from ADI Auxiliary Publications Project, 
Photoduplication Service, Library of Con- 
gress; Washington 25, D. C., remitting in ad- 
vance $1.75 for microfilm or $2.50 for photo- 
copies. Make checks payable to: Chief, 
Photoduplication Service, Library of Con- 


gress 
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absolute difference between corrected 
and uncorrected r’s was only .05. 

For boys, a review of the correla- 
tions at the 1% level reveals that the 
three kinds of performance (scientific, 
artistic, and academic) are associated 
with somewhat different variables, 
generally in expected directions. 

The boy with a high score on the 
Creative Science Scale also has many 
artistic achievements (3) and Crea- 
tive Activities (8), plans to get an 
advanced degree (71), is a first-born 
or an only child (74), and has high 
scores on the Independence of Judg- 
ment (17), Mastery (19), Deferred 
Gratification (20), Initiative (23), 
Physical Activity (28), and Intellec- 
tuality (29) scales and low scores on 
the Responsibility (30) and Status 
(36) scales. He rates himself high on 
Originality (37), Independence (40), 
and Perseverance (42). Fathers of 
boys high on scientific performance 
regard curiosity (48) as a valuable 
trait for their sons to have; mothers 
of these boys tend to be agreeable 
(supposedly comfortable in their role 
as mothers) rather than irritable (59). 

The boy with a high score on the 
Creative Arts Scale engages in many 
Creative Activities (8), plans to get 
an advanced degree (71), and has high 
scores on the Esthetic Sensitivity (12), 
Sense of Destiny (13), DRS (Total 
Score) (14), Breadth of Interest (21), 
Self-Evaluation (22), Self-Assurance 
(24), Occupational Level (25), Re- 
sponse Bias (Acquiescence) (26), Re- 
sponsibility (30), Verbal Activity 
(32), Emotionality (33), Control 
(34), and Status (36) scales, and low 
scores on SAT-M (5). He rates him- 
self high on Originality (37), Drive to 
Achieve (39), Independence (40), 
Self-Confidence (41), and Persever- 
ance (42). Mothers of these boys are 
slightly more accepting of the home- 
making role than are mothers of stu- 
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CORRELATIONS BETWEEN THREE CRITERIA OF ACADEMIC 
AND 72 


Variable 


HSR 


l 
2. Scientific Performance 


3. Artistic Performance 

4. SAT-V 

5. SAT-M 

6. Humanities Comprehen 
s10n 

7. Scientific Comprehension 

8. Creative Activities 
(NMSS 


Gough DRS 

9. Intellectual Competence 
10. Inquiringness 

11. Cognitive Flexibility 

12. Esthetic Sensitivity 

13. Sense of Destiny 

14. Total Score (Above 5 

15. Potential Success (PTV) 


Originality-Personality 

16. Complexity-Simplicity 

17. Independence of Judgment 
18. Barron Originality 

19. Mastery 

20. Deferred Gratification 

21. Breadth of Interest 

22. Self-Evaluation 
Ghiselli 

Initiative 

24. Self-Assurance 

25. Occupational Level 


23 


VPI 

26. Response Bias 
27. Infrequency 

28. Physical Activity 
29. Intellectuality 
30. Responsibility 
31. Conformity 

32. Verbal Activity 
33. Emotionality 

34. Control 

35. Masculinity-Femininity 
36. Status 


Self- Ratings 

37. Originality 

38. Popularity 
* Significant at the .05 level 
** Significant at the .01 level 
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TABLE 1 


APTITUDE, PERSONALITY, AND BACKGROUND 
VARIABLES FOR Boys 
(N = 649) 


Creative 
Performance 


Creative 
P. 
erformance 


High 
School 
Grades 


Variable 


Artistic Artistic 


08 - 39. Drive to Achieve 22°° 
15 40. Independence 
41. Self-Confidence 


42 


00 


20°* 
Qe 
23 


15** 


15** 
02 
04 

—01 


—09° Perseverance 
—19°° 
03 Teacher Ratings 
43. Citizenship 

44 


45. Social Leadership 


06 Popularity 


Father's Values and Goals 
46. Defend Self 

47 
48 
49. Dependable 

50. Good Student 

Happy, Well-Adjusted 
Independent, Self- Reliant 


00 
00 
—08* 


—01 
06 
11°° 
10° —02 

—02 06 

—02 01 

—02 04 

—01 01 

—01 00 


Ambitious 


Curious 


52 
Popular 

54. Self-Controlled 

PARI 

55. Fostering Dependency 

07 1 56. Seclusion of Mother 

| 57. Martyrdom 

| 58 

09° 59 

01 60 


07 
10° 


Strictness 

Irritability 

Excluding Outside 
Influences 

61. Suppression of Aggression 
62. Rejection of Homemaking 
Role 

Equalitarianism 

of Activity 


63 
64 
| 65 


Approval 
Avoidance of Communica- 
tion 

Suppression of Sex 
Ascendency of Mother 
Intrusiveness 
Comradeship and Sharing 
Acceleration of Develop- 
ment 


Miscellaneous 

71. Degree (level) Sought 

72. Father's Educational Level 
73. Mother’s Educational 
Level 

Birth Order 
School Size 


74 first born 


AND CREATIVE PERFORMANCE 


High 
School 
Grades 


2ae° 
06 
13°* 


yee 
ra) 


—02 
05 
—(9* 
02 
16°* 
—06 
-13°° 
09° 
— 06 
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TABLE 2 
CORRELATIONS BETWEEN THREE CRITERIA OF ACADEMIC AND CREATIVE PERFORMANCE 


AND 72 APTITUDE, 
(N 


Creative 
Performance 
High 
School 
Grades 


Variable 


ocien 


tific Artistic 


High School Grades 
Scientific Performance 
Artistic Performance 


Humanities Comprehen 

sion 

Scientific Comprehension 
8. Creative Activities 
(NMS8S8) 


Gough DRS 

9. Intellectual Competence 
10. Inquiringness 

11. Cognitive Flexibility 00 09 —12* 
12. Esthetic Sensitivity 06 06 —Oi 

13. Sense of Destiny 03 23°* 04 

14. Total Score (Above 5 —01 14°* | —o8 


15. Potential Success (PIV 04 00 00 


—Ol 


—03 


—14°* | —02 
00 02 


Originality-Personality 

16. Complexity-Simplicity 

17. Independence of Judgment 06 02 

18. Barron Originality 07 10 

19. Mastery 19°* 02 

20. Deferred Gratification 11° 03 
Breadth of Interest 18°* 24°° 


9 
22. Self-Evaluation os i9** 


02 


Ghiselli 

23. Initiative 

24. Self-Assurance 

25. Occupational Level 


VPI 

26. Response Bias 

27. Infrequency 

28. Physical Activity 
29. Intellectuality 

30. Responsibility 

31. Conformity 

32. Verbal Activity 
33. Emotionality 

34. Control 

35. Masculinity-Femininity 
36. Status 


Self- Ratings 
37. Originality 
38. Popularity 


32° 
—01 10 


* Significant at the .05 level 
** Significant at the .01 level 


345) 


Variable 


39. Drive to Achieve 


40. Independence 
41. Self-Confidence 
42. Perseverance 


Teacher Ratings 

43. Citizenship 

44. Popularity 

45. Social Leadership 


Father's Values and Goals 
46. Defend Self 

47. Ambitious 

48. Curious 


| 49. Dependable 


50. Good Student 

51. Happy, Well-Adjusted 

52. Independent, Self-Reliant 
53. Popular 

54. Self-Controlled 


PARI 
Fostering Dependency 
Seclusion of Mother 
Martyrdom 
Strictness 
Irritability 
Excluding Outside 
Influences 
Suppression of Aggression 
Rejection of Homemaking 
Role 
Equalitarianism 
Approval of Activity 
Avoidance of Communica 
tion 
Suppresmon of Sex 
Ascendency of Mother 
Intrusi veness 
Comradeship and Sharing 
Acceleration of Develop 
ment 


Miscellaneous 
71. Degree (level) Sought 
72. Father's Educational Level 


| 73. Mother's Educational 


Level 
Birth Order (first born 
School Size 


PERSONALITY, AND BackGRoUND VARIABLES FOR GIRLS 


Creative 
Performance 


Artistic 


13° 
12° 
11° 
13° 
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High 
School 
Grades 


18** 
—04 


22° 
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dents with low artistic performance 
(62). 

The variables related to academic 
performance are somewhat different 
from those related to creative per- 
formance. Academic performance 
(HSR) is negatively correlated with 
high scores on the Complexity-Sim- 
plicity (16), Independence of Judg- 
ment (17), and Barron Originality 
(18) scales and positively correlated 
with high scores on the Mastery (19), 
Deferred Gratification (20), Self- 
Evaluation (22), Self-Assurance (24), 
Control (34), and Status (36) scales. 
Boys with high grades rate themselves 
high on Popularity (38), Drive to 
Achieve (39), Self-Confidence (41), 
and Perseverance (42). Their teachers 
rate them high on Citizenship (43), 
Popularity (44), and Social Leader- 
ship (45). Fathers of these students 
want their sons to be Good Students 
(50) and are less concerned with their 
being Independent and Self-Reliant 
(52). Mothers tend to be authoritarian 


(at the 1% level), Avoidance of Com- 
munication (65); at the 5% level, Se- 
clusion of Mother (56), Martyrdom 
(57), Suppression of Aggression (61), 


and Acceleration of Development 
(70). 83 

The findings for girls, shows in Ta- 
ble 2, are similar to those for boys. 
The girl with a high score on the 
Creative Science Scale tends to en- 
gage in many Creative Activities (8), 
plans to get an advanced degree (71), 
has low scores on the Intellectual 
Competence scale (9) and high scores 
on the Mastery (19), Breadth of In- 
terest (21) scales. She rates herself 
high on Drive to Achieve (39). Her 
father ranks being Dependable (49) 
low on the list of goals and traits 
which he values for his children. 

The girl with a high score on the 
Creative Arts Seale has high scores 
on the Creative Activities (8), Sense 


JOHN L. HOLLAND 


of Destiny (13), DRS (Total Score) 
(14), and Breadth of Interest (21) 
scales; has a positive Self-Evaluation 
(22), and rates herself high on Origi- 
nality (37). 

Academic performance is negatively 
correlated with high scores on the 
Creative Activities (8) and Complex- 
ity-Simplicity (16) scales and posi- 
tively correlated with high scores on 
SAT-M (5) and the Deferred Gratifi- 
cation (20), Control (34), Status (36), 
and Self-Assurance (24) scales; with 
high Self-Ratings of Drive to Achieve 
(39) and Perseverance (42), and high 
Teacher Ratings of Citizenship (43), 
Popularity (44), and Social Leader- 
ship (45). Fathers of girls who get 
high grades value being Dependable 
(49) and do not value being Curious 
(48). Mothers of these girls are char- 
acterized by the PARI as “authori- 
tarian”—Seclusion of Mother (56), 
Supression of Aggression (61), Accel- 
eration of Development (70). 

The differences between creative 
and academic performance for the 72 
variables replicate the trends found for 
boys. Academic performance appears 
to be the function of a personal syn- 
drome characterized by perseverance, 
self-control, good behavior (good citi- 
zenship), and rigidity ; this personality 
pattern is related to parental attitudes 
which seem conducive to such a pat- 
tern. Creative performance, on the 
other hand, seems to be the outcome 
of a conscious conception of being 
original, active participation in crea- 
tive hobbies, and reinforcement by 
parents who possess values and atti- 
tudes which appear to be conducive to 
such performance. 

Free response analysis. As a part 
of the assessment, students were asked 
about their vocational choice, the fac- 
tors which influenced this choice, and 
their images and daydreams about 
their future occupations. Their free 
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responses to the question, “What do 
you daydream about when you think 
of your future occupation?” were 
coded, using 10 coding categories de- 
veloped from a sample of 200 students 
and tested for reliability on a sample 
of 160 students. Two raters, coding 
independently, obtained 75% agree- 
ment. Tables E and F* compare the 
responses of students high on creative 
performance with those of students 
low on creative performance, and of 
students high on academic perform- 
ance with students low on academic 
performance. 

According to Table E, boys with 
outstanding scientific performance 
daydream of “high achievement and 
creative accomplishment”; for this 


scoring category, the percentage dif- 
ference between high and low science 
scores is significant at the .01 level. 
The same trend is observable in the 
Arts scale, though the percentage dif- 
ference is not significant at the .05 
level. The responses of students above 


the median on HSR do not differ sig- 
nificantly from those of students be- 
low the median. 

Girls with outstanding scientific 
achievement daydream more about 
work activities than about helping 
others (p < .001), whereas girls with 
low achievement are concerned 
with work and more interested in help- 
ing others (p < .05). Again, the com- 
parisons of girls high and low on aca- 
demic achievement do not reveal 
significant differences. 

These results, which support some 
of the correlational findings, imply 
that academic achievement involves 
somewhat different motives than crea- 
tive performance; good grades in high 
school appear to be a function of 
socialization (citizenship and popu- 
larity). and perseverance, whereas 
creative performance is a function of 
conscious concern with high accom- 


less 
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plishment, independence, and origi- 
nality. 

Getzel’s analysis. In a recent study 
of elementary school children, Tor- 
rance (1959), following Getzel’s classi- 
fication of students as “high IQ” or 
“high creative,” reports that the most 
intelligent students (top 20%) are not 
necessarily the most creative (top 
20%): only about 30% of the students 
were in both groups. 

The present study supports Tor- 
rance’s findings. Eight tables were 
obtained for the present study by 
relating SAT-V and SAT-M to the 
scientific and artistic checklist scores 
for each sex. Within each table, dis- 
tributions of creative performance 
scores were formed for approximately 
the top 20% of students on the SAT 
and the top 20% of students on crea- 
tive performance. The percentages of 
overlap between these two contrasting 
student groups ranged from 1-6.5% of 
the total samples for the eight tables 
and deviate only slightly from an ex- 
pected overlap of 4%. The larger de- 
viations were in the direction expected 
from the correlations in Tables 1 and 
2. These results are consistent with the 
negligible correlations between apti- 
tude and outstanding creative achieve- 
ment shown in Tables 1 and 2. We 
may conclude, then, that in a group 
of exceptionally bright students, in- 
telligence has little or no relationship 
to creative performance in arts and 
science or to academic achievement. 

These results may in part be a func- 
tion of the regression of creativity on 
aptitude; students are selected ini- 
tially for their high aptitude, and 
then the relationships between apti- 
tude and creativity are studied within 
this narrow range of aptitude. These 
low relationships are, only in part, a 
function of the narrow range on apti- 
tude, however. In Tables A and B of 
the ADI material SAT-V and SAT-M 
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correlate as much as .64 and .57 with 
the Humanities and Scientific Com- 
prehension scores of the National 
Merit Scholastic Scholarship Test (an 
achievement test given about one year 
before the SAT was administered). 
Even these correlations are probably 
underestimates, due to the artificial 
restriction of range imposed on the 
NMSQT by its use as a selection de- 
vice for this sample. The latter find- 
ings suggest that the SAT does dis- 


criminate efficiently and _ reliably 


within this narrow range of talent so 
that higher relationships between ap- 
titude and creative as well as academic 
performance were possible. 


DIscuUSsSION 


The results of the present study are 
probably conservative. The distribu- 
tion of scores for all criteria are at 
least moderately skewed and all scales 
have relatively low reliability; more- 
over, the range of scores on the re- 
maining predictor variables, including 
background variables, is restricted. 
Therefore, the correlational results 
are probably underestimated. Since 
the students in the sample are all ex- 
ceptionally talented, the correlations 
between originality measures and 
scholastic aptitude are reduced. 
Whether or not the observed relation- 
ships can be generalized to more repre- 
sentative student populations is ques- 
tionable. 

The correspondences between the 
present study and related studies are 
numerous. The originality scales de- 
veloped by Barron (Independence of 
Judgment, Complexity-Simplicity, and 
Originality) and by Gough (DRS) 
have been frequently correlated with 
criteria of creative performance and 
our results are generally consistent 
with earlier reports (Barron, 1953a, 
1953b; Gough, 1957b). Although the 
relationships obtained in this study 
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are generally low, it is surprising that 
the Barron and Gough scales correlate 
at all, since they were constructed for 
adult samples and used different cri- 
teria of creative behavior. 

The CAS has promising validity 
since it is the best single correlate of 
creative performance (r’s range from 
.23-.37 for the CAS against the Arts 
and Science criteria for both sexes), 
and since its highest correlations are 
with a set of variables which lend sup- 
port to this interpretation. For boys, 
the variables having the largest corre- 
lations with the CAS are, in descend- 
ing order (.37-.15): Breadth of Inter- 
est, Self-Ratings of Originality and 
Independence, Emotionality, Self-Rat- 
ings of self-control, Total DRS Score, 
Complexity-Simplicity, level of degree 
sought, and Barron Originality. For 
girls, the largest correlates of the CAS 
are (.43-—.16): Breadth of Interest, 
Self-Ratings of Originality and Inde- 
pendence, Barron Originality, Com- 
plexity-Simplicity, Sense of Destiny, 
Self-Evaluation, and mother’s educa- 
tion. The Fostering Dependency and 
Ascendency of Mother scales of the 
PARI correlate negatively with the 
CAS (—.16 and —.17, respectively). 

The assumed validity of the CAS 
may be overestimated, since 4 or 5 of 
the 32 scale items involve activities 
which are preparatory to or associated 
with the accomplishments listed in the 
Creative Science and Arts Scales. The 
correlates of the CAS listed above im- 
ply some validity independent of the 
CAS’s correlations with the perform- 
ance scales, however. 

The CAS was suggested by the 
Chorness and Nottelmann study 
(1957) in which it was found that a 
set of extracurricular hobbies had sig- 
nificant correlations (.27-.45) with 
four or five Guilford factor composites 
when intelligence is partialed out. The 
item overlap, if any, between the 
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Chorness creative hobbies and th 
CAS is not known. 

The unexpected concurrent validity 
of the Self-Ratings is of special inter- 
est; of all the variables used, the Self- 
Ratings show most clearly that aca- 
demic and creative performers con- 
ceive of themselves as different from 
other people. It is of interest too that 
high Self-Ratings of Perseverance and 
Self-Confidence—two of the three 
most discriminating traits for Ter- 
man’s high and low achievers—are 
correlated here with both creative and 
academic performance (Terman & 
Oden, 1947). 

The findings for the Intellectuality 
and Emotionality scales of the VPI 
appear to replicate several studies 
(Barron, unpublished; MacKinnon, 
1959) in which vocational interests in 
science and the arts were found to be 
associated with rated creative per- 
formance and high scores on tests of 
creative behavior. Since the Intellec- 
tuality scale has its highest significant 
correlations with the Self-Sufficiency, 
Schizothymia, and Masculinity scales 
of the 16 PF, the present results are 
consistent with the characterization of 
the creative person as independent, 
asocial, and masculine. Similarly, the 
Emotionality scale of the VPI is cor- 
related most highly with femininity, 
instability, and introversion (16 PF) 
Holland, 1960b). 

Generally, the results seem to sup- 
port many other hypotheses about the 
nature of the creative person, but an 
attempt to relate all of the specific 
findings to the voluminous theorizing 
about creativity would be a gar- 
gantuan task. Briefly, those hypoth- 
eses which regard the creative person 
as independent, intellectual, expres- 
sive, asocial, consciously original, and 
open to experience gain some support 
(Taylor, 1955, 1957, 1959). The cre- 
ative student not only has an identi- 
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fiable personal disposition, but also he 
has relationships with teachers and 
parents which are in accordance with 
our expectations. His parents appear 
to be more permissive and more nur- 
turant of his ideas and impulses so 
that communication with the self and 
the world is stimulated. It is not sur- 
prising, then, that such students ap- 
pear to come in conflict. with teachers 
who demand conforming, controlled, 
nonexploratory behavior. 

Perhaps the most unequivocal find- 
ing in the present study is that, for 
saroples of students of superior scho- 
lastic aptitude, creative performance 
is generally unrelated to scholastic 
achievement and scholastic aptitude 
Since the traditional predictors of 
scholastic aptitude are of little or no 
value for predicting creativity, it 
seems clear that scholarship programs, 
colleges, and other agencies, if they are 
concerned primarily with rewarding 
students or selecting employees who 
have potential for creative perform- 
ance, need to make a more active ef- 
fort to devise predictors of creative 
potential. In fact, attempts to build 
better scholastic aptitude tests may 
even be detrimental, since they may 
lead to a greater dependence on instru- 
ments which are of limited value and 
thus delay unnecessarily the develop- 
ment of efficient predictors of creative 
performance. 

The finding that teachers generally 
rate students with good grades higher 
than those with lower grades, together 
with the results of an earlier study 
(Holland, 1959b) which indicates that 
teachers give lower ratings to students 
with more potential for creativity (as 
measured by the 16 PF) than to stu- 
dents with less potential, suggests that 
school personnel value the good grade- 
getter more than the creative student. 
Recently, Jex (1958) found that school 
principals rate teachers with high 
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scores on an ingenuity test lower than 
teachers with low test scores. Taken 
together, these results reinforce a com- 
mon belief that some of our traditional 
education may be stultifying rather 
than nurturant and fructifying. 


SUMMARY 


The relationships between three 
criteria of academic and creative per- 
formance and 72 personal, demo- 
graphic, and parental variables were 
studied in a sample of talented adoles- 
cents. The results suggest that creative 
performance at the high school level 
occurs more frequently among stu- 
dents who are independent, intellec- 
tual, expressive, asocial, consciously 
original, and who have high aspira- 
tions for future achievement. Students 
who are persevering, sociable, respon- 
sible, and whose parents hold some- 
what authoritarian attitudes and val- 
ues, are more frequently academic 
achievers. The negligible relationships 
found between academic aptitude and 
creative performance at a high apti- 
tude level suggest that we need to use 
nonintellectual criteria in the selection 
of students for scholarships and fel- 
lowships. 
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CHILDREN OF LOW, AVERAGE, AND 
HIGH INTELLIGENCE’ 
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The range of differences among 
school children in many intellectual 
and psychomotor abilities and other 
characteristics is defined clearly. Less 
clearly defined are the factors which 
contribute to the differences. Previ- 
ously, no statistically significant dif- 
ference was found among groups of 
low, average, and high IQ children in 
retention of arithmetic problems, 
graded to each child’s achievement 
level (Klausmeier & Feldhusen, 1959) ; 
nor in emotional adjustment, integra- 
tion of self-concept, and achievement 
in relation to expectancy (Klausmeier, 
Check, & Feldhusen, 1960). Large 
differences with little overlapping 
between IQ levels were found in 
achievements in reading, language, 
and arithmetic. The purpose of this 
investigation was to ascertain possible 
differences among the three groups in 
efficiency of method, persistence, and 
mode of attack while in the actual 
process of solving arithmetic problems 


PROCEDURE 


Subjects 


The subjects were 20 boys and 20 girls 
with WISC IQs of 55-80, 20 boys and 20 
girls with WISC IQs of 90-110, and 20 boys 
ind 20 girls with WISC IQs of 120-146. The 
80 children of high and average IQ were 
enrolled in 15 regular fifth grade classes of 
two large public school systems; and the 
40 low IQ children were enrolled in 14 spe- 
cial classes for educable mentally retarded 
children in the same schools Excluded from 


research reported herein was per- 
formed pursuant to a contract with the 
Office of Education, United States Depart- 
ment of Health, Education, and Welfare 


AND 
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low IQ children exhibiting 
a marked degree or 


the study 
a second handicap to 
definite organic symptoms of retardation 
such as mongolism. All had birthdates be- 
tween September 15, 1947, and December 15, 
1948; and the age at the time of 
gathering the data was 131 months for each 


were 


mean 


IQ grou 


Methods 
The 


erly grade 


first task was to get problems prop- 
| in difficulty. After extensive ex- 
perimenting with pupils in regular 
rooms and with low I1Q pupils not in the 
study, a group of 29 problems at three main 
levels of difficulty was arranged. The prob- 
lems for IQ children were sub- 
divided further with the lowest level in- 
tended for who did not know the 
number of cents in a dime or who could not 
perform le addition. A reserve level 
of problems of high difficulty estab- 
lished for the high IQ child who might solve 
an assigned problem in less than 3 minutes 
The least difficult problem designed for 
low IQ child was to make 7¢ with three coins 
and difficult designed for a high 
IQ chil » make $14.53 with 16 bills and 


class- 


low 


the 
tnose 


Sim] 


was 


a 
the most 
i was t 
initial formulation of prob- 


r measures were used to make 


thie 
nl 


B 


lems, two othe 


esides 
certain that the problem was of appropriate 
difficulty. A survey test was administered to 
each child to ascertain his knowledge of our 
system, related vocabulary, and 
ithematical skills. Also, if child 
ussigned problem in less than 
next problem in order of diffi- 


noney 


It a com- 
pleted his 


t} 


3 
ninutes, € 
ulty was assigned 

Each child solved only one problem. This 
and the survey test mentioned pre- 
iously were administered by a carefully 
trained examiner; and another trained per- 
son observed the entire procedure. From the 
the problem and instructions were 
given the child until the problem was solved 
time in and incidence of the 
following behaviors of the child were re- 
corded: (a) manipulations of coins by the 
low IQ children or manipulation of figures 


rroblem 


time 


seconds the 
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with pencil and paper by the average and 
high IQ children; (b) engaging in nontask 
activities or withdrawal which resulted in the 
examiner's encouraging the child to con- 
tinue his problem solving; (c) offering an 
incorrect solution; (d) noting and correct- 
ing mistakes independently; (e) verifying 
the solution by checking the amount of 
money independently; (f) verifying the 
solution by checking the number of coins 
independently; and (g) using a random, 
logical, or a combination approach to the 
solution. In random approach the subject 
merely manipulated or explored the materi- 


ils without an apparent plan of attack. In 


logical approach the subject made deliberate 


trials 
changed from an 
logical approach, 


manipulations to test successive or 
Some children 


ipparently random 


hypothese s 
to a 
und vice versa 

Efficiency of the 
fined as the ratio of moves (coins or 
pencil to the 
number needed to achieve the solution 
example, the least efficient subject made 
moves when only 2 were required, 
resulting efficiency ratio of 051. Any instance 
of a child’s being encouraged by the ex- 
iuminer to cease from a nontask activity or 
to continue at the task was recorded as the 

of nonpersistence. The of 

attack was observed in the verbal responses 
of the subject and in his manipulations of 
coins or figures, as described in the preced- 
ing paragraph, c through f 

The 
tabulated 


IQ groups 


child’s method was de- 
paper- 
least 
For 
39 
with a 


computations made) 


measure mode 


were 
the 


data secured on each subject 
and according t 
Analysis of variance 


combined Oo 


was US d to 
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compare efficiency of method and chi square 
to compare incidences of the other behaviors 
among the three groups 


RESULTS 


The extent to which the problems 
were of equal difficulty for each IQ 
group was ascertained by comparing 
the time in seconds required to reach a 
solution to the problem. The low IQ 
group required a mean time of 624.17 
seconds, the average group 627.65, and 
the high group 578.47 seconds. On the 
basis of a small and insignificant F 
value obtained among the means, it 
was concluded that the assigned prob- 
lems were about equally difficult for 
the three IQ groups 

A summary of the data and the 
results of the tests of statistical sig- 
nificance of differences among the 
three IQ groups and between groups 
are presented in Table 1. Column 
1 lists the observed behaviors. Col- 
umns 2—4 contain the scores or number 
of subjects in each IQ group who dem- 
onstrated the behavior. Column 
shows the results of the tests of sta- 
tistical significance of differences 
among the three IQ groups. Columns 
6-8 give the results of the tests of sig- 
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TABLE 1 


SUMMARY OF OBSERVED SCORES 


AND Resvutts or Tests or STATISTICAL 


SIGNIFICANCE 


or DIFFERENCES 


Score or 


Incidence 


Efficiency of Method (% 

Nonpersistence (Incidence 

Mode of Attack (Incidence 
Offered Incorrect Solution 
Noted and Corrected Mistakes 
Verified Solution—Amt. Money 
Verified Solution—No. Coins 


10 
14 


Random Approach 


Logical Approach 


* Not significant at .05 level 


001 


ns 


001 
001 
001 


Significance of Differences 


Between Groups 


Hi Av-Low 


Low 


01 
001 


° 05 
01 |.01 


ns 
> ?p 


> ?pP 


> p 02 


001 > 


Pp 001 01> p 001 
001 > 
001 

0l>p 

01> p> 


001 

001 

001 
> p 


001 

001 > p 

001 > p 
05 > p> 


> Pp 
>p 
>—p 


Pp 
> p 

001 
001) .01 


001 02 





150 


nificance of differences between groups 
—high and average, high and low, and 
average and low. 

Table 1 shows that the low IQ group 
was inferior to the high IQ and to the 
average IQ group in seven and six of 
the observed behaviors, respectively ; 
the average IQ group was inferior to 
the high IQ in six behaviors. Although 
the mean number of seconds to solve 
was nearly identical for the three 
groups, the incidences of behaviors 
were greatly different. To clarify the 
differences, short sketches of the pro- 
cedures used by a high and a low IQ 
boy are now given. 

Richard had a WISC IQ of 138 and 
used 585 seconds to solve the problem: 
“Make $9.77, using 12 bills and coins.” 
He studied the situation and during 
the first 3 minutes made a first at- 
tempt at solution, getting the amount 
correct but using 13 instead of 12 bills 
and coins—9 one dollar bills, 1 half- 
dollar, 1 quarter, and 2 pennies. He 
checked the amount and number of 


coins and started over. During the 
next 3 minutes he made his second 
and third tries, each time starting with 
a five dollar bill. On the second he had 


12 bills and coins but an incorrect 
amount; on the third try, neither was 
correct. Each time he checked amount 
and number of coins. During the third 
3 minutes he made his fourth try, but 
made a mistake in adding the amourt. 
Checking through his solution at the 
beginning of the fourth 3-minute pe- 
riod, he found the error and after 45 
seconds offered as a correct solution 
1 five dollar bill, 4 one dollar bills, 1 
half dollar, 1 dime, 3 nickels, and 2 
pennies. Richard made 25 separate 
moves, but only 6 were needed, as 
shown in the final solution. Therefore, 
his efficiency ratio was 6/25, or .24. 
In terms of a problem solving se- 
quence set forth by Merrifield, Guil- 
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ford, Christensen, and Frick (1960), 
tichard (a) accepted the task as a 
problem and set a goal of achieving a 
correct solution, (b) analyzed the 
available information in relation to 
his goal, (c) produced a solution and 
independently rejected it (verifica- 
tion), (d) applied knowledge from 
this and subsequent solutions to each 
successive solution produced (reappli- 
cation), and (e) finally verified and 
accepted the correct one. 

Michael, one of the more able low 
IQ boys, had a WISC IQ of 73 and 
used 805 seconds to “Make 46¢, using 
4 coins.” Ten coins of each demoni- 
nation—penny, nickel, dime, and 
quarter—had been placed on the table 
before him. (In a pretest it had been 
established that he had the requisite 
skill in adding and knowledge of coins 
to solve the problem.) Michael, as 
Richard, restated the problem cor- 
rectly prior to attempting a solution. 
During the first 3 minutes, Michael 
took 3 dimes and 10 pennies from the 
supply, then returned to the supply 
3 pennies, one at a time, and offered 
the remainder as a correct solution. 
Upon being told that it was incorrect 
and with all coins returned to the sup- 
ply, he studied the coins and offered 1 
quarter and 2 dimes as a second solu- 
tion during the second 3 minute period. 
During the third 3 minutes, he with- 
drew from the supply 1 quarter, | 
dime, 1 nickel, and 1 penny and of- 
fered this as correct. When told it was 
incorrect and the coins had been re- 
turned, he again studied the coins, and 
during the fourth 3 minutes withdrew 
1 quarter, 1 penny, 1 dime, then put 
the quarter back. During the fifth 
3 minutes he again withdrew the 
quarter and another dime from the 
supply, thus having 1 quarter, 2 dimes, 
and 1 penny. This he offered as cor- 
rect without observably checking ac- 
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curacy of amount or number of coins. 
He made a total of 16 coin movements 
when only 3 were needed; his ef- 
ficiency ratio was .188. At no point 
was it necessary to encourage Michael 
to continue or to keep at the task; 
however, like the majority of low IQ 
children, he offered incorrect solutions 
and did not verify amount of money 
nor the number of coins. 

In what respects are the low 1Q 
most different from the high IQ chil- 
dren? As noted in the above descrip- 
tions, the high IQ boy was markedly 
superior in verification and reapplica- 
tion, eventually arriving at the correct 
solution. Further, other low IQ child- 
ren, different from Michael, did not 
persist when informed that their solu- 
tions were wrong, and after two or 
three such experiences, manipulated 
the coins without producing a close ap- 
proximation of the final correct solu- 
tion. 


DISCUSSION 


If time to reach a correct solution 
had been used as the criterion of ef- 
ficiency of the problem solving, no sig- 
nificant difference would have been 
observed among the three groups. Us- 
ing the ratio of efficiency as the cri- 
terion, a significant difference was 
observed. The differences of most prac- 
tical significance among the groups 
were connected with producing pos- 
sible solutions, verifying each proposed 
solution, and applying information 
from each preceding trial to the sub- 
sequent one. As John (1957), Duncan 
(1959), and others have pointed out, 
processes such as these used in arriv- 
ing at solutions are the important vari- 
ibles in understanding efficiency of 
performance and learning. 

Whether more of the low IQ chil- 
dren in this study could learn seem- 
ingly simple processes as deciding a 
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plan for making 13¢ with four coins is 
not known. Similarly, verifying the 
amount of money and number of coins 
does not appear to be difficult, al- 
though the high IQ children also 
tended to do only one or the other on 
the first try. If these processes can be 
learned, more specific instruction in 
school devoted to helping children ac- 
quire processes, rather than solutions, 
would be helpful. 

Though not studied intensively, dif- 
ferences within each IQ group were 
large. For example, the ratio of ef- 
ficiency varied from .10 to .80 among 
the high IQ children. Further, 10 high 
and 16 average IQ children offered in- 
correct solutions as shown in Table 1. 
Help given to children of average and 
high abilities when needed might be 
especially profitable in achieving im- 
proved problem solving performances. 


SuMMARY 


Differences among groups of chil- 
dren of low, average, and high IQ were 
found in observed behaviors as they 
solved problems, graded in difficulty to 
their present achievement levels. The 
high IQ children showed a greater in- 
cidence than the average and the low, 
and the average a greater incidence 
than the low in noting and correcting 
mistakes independently, verifying 
solutions, and using a logical ap- 
proach; whereas the low IQ showed 
a greater incidence than the average 
and the high, and the average a 
greater incidence than the high in 
nonpersistence, offering an incorrect 
solution, and using a random ap- 
proach. The high IQ children were su- 
perior to the low in efficiency of 
method, as ascertained by the ratio 
of number of moves made to the least 
number required for solution of the 
problem. Differences in performances 
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among individuals within IQ groups 


were also large 
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THE RELATION BETWEEN SEVERAL PARENT 
MEASURES AND THE CHILD’S EARLY 
ADJUSTMENT TO SCHOOL’ 


GENE R. MEDINNUS 


San J ose State Colle gé 


The present paper reports data deal- 
ing with first grade readiness and ad- 
justment in first grade. The purpose of 
this study was to explore the relation- 
ship between parental attitudes to- 
ward a number of aspects of child 
rearing, as assessed through question- 
naires administered to both parents 
and through interviews with the 
mother, and the child’s general adjust- 
ment in Grade 1. 


‘ 
< 


METHOD 


Subjects 


The subjects in the investigation were 
a group of first graders and their parents 
Two groups of children were identified 
through the teacher’s rating of their adjust- 
ment in first grade on a five-point scale, with 
5 representing good adjustment, 3 typical 
of the adjustment of the “average” child, 
and 1 denoting poor adjustment. The rating 
was made on the basis of and following the 
teacher’s rating of the children on a 52-item 
First Grade Adjustment Scale. Those 10 
children receiving ratings of 4 and 5 were 
treated as one group; the other group was 
comprised of those 9 with ratings of 1 and 2 
The mean IQ of the children was 1116 ac- 
cording to the Stanford-Binet (Form L) in- 
telligence tests administered by the in- 
vestigator. The socioeconomic status of 
the families was approximately evenly di- 
vided between the upper-lower and lower- 
middle classes according to Warner’s Index 
of Status Characteristics (Warner, Meeker, 
& Eells, 1949). At the beginning of the study 
the mean ages of the mothers and fathers 
were 32.1 and 34.1 years, respectively, and 
the corresponding mean years of education 
were 12.0 and 12.2 


‘This research was completed under the 


sponsorship of the Elizabeth McCormick 


Memorial Fund of Chicago 
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Scales 


The two instruments employed to assess 
parental attitudes and behavior will be de- 
scribed first. Data from these two measures 
were obtained during the year prior to the 
child’s entrance into first grade 

The parents were asked to complete a 
form of the Parent Attitude Research In- 
strument (PARI) developed at the National 
Institute for Mental Health. The develop- 
ment of the scale, its uses and reliability 
coefficients have been described in some 
detail by Schaefer and Bell (1955, 1958) 
Briefly, the scale is a Likert-type question- 
naire consisting of a number of subscales 
each concerned with various aspects of 
family life, child rearing attitudes, and re- 
lationships. The particular forms of the 
scale employed consisted of 29 subscales 
for the mothers and 25 for the fathers. The 
responses to the items were scored either 4, 
3, 2, or 1, depending upon whether the re- 
sponse was “Strongly agree,” “Somewhat 
agree,” “Somewhat disagree,” or “Strongly 
disagree,” respectively. The questionnaires 
left with the parents following an 
evening home visit by the investigator 
They were returned as they were completed 

The Fels Parent Behavior Rating Scales 
originally were designed in an attempt to 
identify of the home environment 
which be expected to bear some 
causal relation to the development of the 
child’s personality (Baldwin, Kalhorn, & 
Breese, 1949; Champney, 1941). Lorr and 
Jenkins (1953) further analyzed the inter- 
correlations of the Fels scales presented by 
Roff (1949) in an attempt to determine 
second-order factors a broad character 
which would be useful for conceptualizing 
the parent-child relationship. Three factors 
emerged ; for convenience in the present dis- 
cussion these will be labeled follows: 
(a) Dependence vs. Independence Encour- 
aging, (b) Democratic vs. Authoritarian, 
(c) Degree of organization in the home 
Those five scales having the highest loadings 
on each of these three factors were employed 
in the present study. The ratings were made 


were 


s 


areas 
might 


of 


as 
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by the investigator on the basis of home 
visits and interviews with the mothers 
Interrater reliability was established through 
previous ratings of 10 homes by the in- 
vestigator and a graduate assistant? The 
mean reliability of these ratings for the 15 
scales was 80. A list of the 15 rating scales 
is provided in Table 1. 

For the purpose of assessing the sub- 
jects’ adjustment to the first grade situation, 
a First Grade Adjustment Scale was de- 
veloped (Medinnus, in press). Briefly, the 
following procedure was employed in the 
construction of the scale. Twenty-five first 
grade teachers were interviewed concerning 
factors related to a child’s adjustment in 
Grade 1. The teachers were asked to mention 
specific traits, abilities, and items of be- 
havior which, in their opinions, characterize 
or describe good adjustment and poor ad- 
justment in the first grade. The character- 
istics listed for good and poor adjustment 
were examined for parallel items which 
seemed to define opposite ends of a single 
continuum. Those items for which there 
was at least a minimum level of consensus 
were placed on a five-point scale, with 3 
representing the midpoint or rating of the 
“average” child, and 1 and 5 describing poor 
and good adjustment, respectively. The 52 
items were grouped into five major areas: 
Physical Status, Social Behavior, Emotional 
Behavior, Intellectual Abilities and Be- 
havior, and Adjustment to Classroom Mem- 
bership and Requirements. Interrater reli- 
ability coefficients for the five sections and 
for the full scale clustered about .75 


RESULTS 


Those PARI scales which differenti- 
ated significantly between the parents 
of the two groups of children will be 
mentioned first. The fathers and 
mothers were compared separately 
since the subscales and the items were 
not identical for the two forms. The 
following scales differentiated between 
the mothers of the well- and poorly 
adjusted first graders at the .05 level 
or beyond: Approval of Activity, Ir- 
ritability, Dependency of Mother, and 
Fear of Harming Baby. Mothers of 
the well adjusted children showed 
more of the attributes measured by 


* The writer is grateful to Floyd Ayers for 
assistance with ratings 
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the first three scales than did the 
mothers of the poorly adjusted chil- 
dren; the reverse was true for the 
fourth scale mentioned. No scales 


reached this significance level for the 
fathers. 

The results for the Fels scales are 
given in Table 1. 


DISCUSSION 


If there is any validity to the prem- 
ise that the child’s behavior and per- 
sonality are in part causally deter- 
mined by parental attitudes one would 
expect wide differences between the 
attitudes of parents of well- versus 
poorly adjusted first grade children. 
That such was not revealed in the 
present analysis is apparent from the 
fact that only four scales differenti- 
ated between the two groups of 
mothers and none of the scales reached 
the significance level for the fathers. 
One possible interpretation of this 
finding emphasizes the lack of valid- 
ity in the parent attitude scale em- 
ployed. Another interpretation as- 
sumes that there is actually no 
relation between parental attitude and 
the child’s general adjustment in the 
school situation. The findings with 
regard to the Fels scales seem to 
furnish evidence to discount this in- 
terpretation. 

It is apparent from Table 1 that 
while only 5 of the 15 Fels scales dif- 
ferentiated between the home envi- 
ronments of the two groups of chil- 
dren, 3 of the 5 were included in the 
Dependence vs. Independence Encour- 
aging factor. In addition, the parents 
of the well adjusted group were rated 
higher on the Solicitousness variable 
but the difference was not statistically 
significant. It should be noted also 
that in each case the homes of the well 
adjusted children were rated higher in 
the dependence-encouraging direction. 
While this would seem to run counter 





PARENT MEASURES AND SCHOOL ADJUSTMENT 


TABLE 1 
Ratines or Homes or Two ADJUSTMENT GROUPS 


Well Adjusted 


Fels scales 
M®* 


A. Dependence vs. Independence 
Encouraging 
4.1 General babying 


1.91 Child centeredness of home 
.1 Solicitousness for welfare 
.2 General protectiveness 
1: 


2 Intensity of contact with 


mother 


9 
*. 


. Autocratic vs. Democratic 
3.15 Nondemocracy of policy 
3.22 Coerciveness of suggestion 
3.14 Nonjustification of policy 
3.11 Restrictiveness of regulations 
8.2 Emotionality toward child 


}. Organization and Effectiveness of 
Control 
3.12 Readiness of enforcement 48. 


3.3 Accelerational attempt 55 
‘ 


Coordination of household 49 


1 
1.2 Activeness of home 47 


* The raw score ratings were converted to McCall 7's 


to the notion of the need for independ- 
ent behavior in the school setting, the 
findings obtained here concerning the 
three scales, General babying, Child 
centeredness of the home, and Pro- 
tectiveness, are in accord with the 
results of other investigations (Bald- 
win et al., 1949; Bandura & Walters, 
1959). In their interpretation of the 
parent behavior ratings, the Fels re- 
searchers identified an “indulgence” 
pattern consisting of three variables, 
Babying, Protectiveness, and Solicit- 
ousness. High ratings on these vari- 
ables were interpreted as indicating 
either one of two processes in the 
home: “(a) the mother is warmly 
doting and protective of the child; or 
(b) she is anxious and restrictive lest 
the child endanger himself or discom- 
mode her” (Baldwin et al., 1949, p. 8). 
On the basis of the relationship of 


3.13 Severity of actual penalties 47.: 


Poorly Adjusted 


o 


these three variables to other rating 
scales, these investigators concluded 
that “there is a definite tendency for 
those parents who are rated high on 
indulgence to be warm, emotional, 
and unable or unwilling to give the 
child either emotional or physical free- 
dom” (p. 8). 

While two possibilities were de- 
scribed to explain high ratings on the 
indulgence variables, the burden of the 
present discussion is to argue that, in 
the present study at least, the higher 
ratings of the homes of the well ad- 
justed first graders on these variables 
indicate acceptance of the child while 
the lower ratings of the homes of the 
poorly adjusted children point to re- 
jection of the child. Great concern 
with encouraging independence may 
actually reflect parental rejection of 
the child. Parental declarations that 
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the child must learn to “stand on his 
own two feet” and “fight his own 
battles” may be attempts to justify 
nonnurturant and nonsupporting be- 
havior growing out of feelings of re- 


jection. 

This interpretation is similar to 
that of Bandura and Walters (1959) 
who found that the parents of ag- 
gressive boys tended to discourage 
dependency behavior in their sons and 
that parental rejection was related to 
nonnurturant parental behavior. The 
authors state: “Indeed, parental re- 
jection seems to involve a pervasive 
form of punishment of the child’s at- 
tempts to gain emotional support from 
his parents” (p. 68). 


SUMMARY 


The present paper presented data 
concerning the relationship between 
various parental attitudes and be- 
havior and the child’s adjustment in 
first grade. 

A comparison was made of the par- 
ent attitude scores and Fels home rat- 
ings of two groups of children, 10 well 
adjusted first graders and 9 poorly 
adjusted first graders. 

The following results 
from the study: 

1. Four of the 29 PARI subscales 
differentiated significantly between 
the mothers of the groups. None of 
the scales reached the .05 level for the 
fathers 

2. Five of the 15 Fels scales dif- 
ferentiated between the home environ- 


emerged 
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ments of the two groups of children. 
Three of the 5 scales were included in 
the Dependence vs. Independence 
Encouraging factor. 

The results were interpreted as in- 
dicating that the lower ratings of the 
homes of the poorly adjusted children 
on the several dependence-encouraging 
variables reflected parental rejection 
which was a causal factor in the chil- 
dren’s poor adjustment to the demands 
of the first grade situation. 
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ON THE USE OF A SHORT VOCABULARY TEST TO 
MEASURE GENERAL INTELLIGENCE 
JOHN B. MINER 
University of Oregon 


In a prior publication (Miner, 1957) 
the author summarized the results of 
some 21 studies which yielded esti- 


mates of the relationship between 
vocabulary tests and measures of what 
we have come to call general intelli- 
gence. Most of these studies utilized 
samples characterized by 
wide range of ability and employed 
vocabulary measures of intermediate 
length such as those contained in the 
Wechsler or Stanford-Binet tests. The 
general measures were the 1916 Stan- 
ford-Binet, the 1937 Stanford-Binet, 
the Wechsler-Bellevue scales, the 
Wechsler Intelligence Scale for Chil- 
dren, the General Classification Tests 
developed by the Armed Services, and 
the Otis tests. The median correla- 
tion found was .83. On the basis of this 
evidence, plus the knowledge that the 
various general measures themselves 
do not intercorrelate at a much higher 
level, it was assumed that general in- 
telligence can be adequately predicted 
from a vocabulary test. 

The studies of intelligence differ- 
ences between various population sub- 
groups and of manpower utilization 
within the educational and occupa- 
tional systems of this country which 
are presented in Intelligence the 
United States (Miner, 1957) are 
based on findings obtained with 
short vocabulary test. The particular 
test used was found in three separate 
investigations (Hagen & Thorndike, 
1955; Thorndike, 1942; Thorndike & 
Gallup, 1944) to have a reliability in 
the .80 to .85 range. In view of this 
evidence of reliability and existing 
knowledge as regards the relationship 


a 


mn 


a 


rather 
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between vocabulary and general in- 
telligence, the assumption that an 
adequate measure of group differences 
in intelligence was being employed 
seemed justified. 

This conclusion has, however, been 
criticized on several grounds, perhaps 
with some justification. The short vo- 
cabulary test contained only 20 items 
whereas the Wechsler and Stanford- 
Binet measures are considerably 
longer. Furthermore, the short vocabu- 
lary test used a multiple-choice for- 
mat rather than a free response pro- 
cedure. A question was raised as to 
whether the specific vocabulary test 
used in the studies presented in Jntel- 
ligence in the United States was in 
fact as valid a measure of intelligence 
as the presumptive evidence would 
suggest. No information on the cor- 
relation between the short vocabulary 
test and a more general measure was 
presented in the book, nor was such 
information available to the author at 
the time the book was published 

The present work was carried out 
with a view to remedying this de- 
ficiency and casting further light on 
the validity of the conclusions reached 
in Intelligence in the United States 


PROCEDURE AND RESULTS 


In connection with a study designed 
to investigate sales effectiveness, a 
number of tests were administered to 
108 members of the sales organization 
of a large corporation. The tests em- 
ployed included Forms A and B of 
the short vocabulary test originally 
developed by E. L. Thorndike for the 
IER Intelligence Scale CAVD, the 
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Concept Mastery Test (Terman & 
Oden, 1959) devised to measure the 
gifted group in adulthood, and the 
verbal subtests (excluding Vocabu- 
lary) of the Wechsler Adult Intelli- 
gence Scale. The sample was preselec- 
ted on intellectual ability since the 
company characteristically uses tests 
in the screening of applicants. All of 
the men had had a high school educa- 
tion at the minimum. Eighty-eight 
percent had attended college and 68% 
had graduated. Within the sample 
the most frequent occupation was that 
of salesman. However, approximately 
a quarter of the men were at the man- 
agement level when tested. None had 
a Wechsler Verbal IQ below 100. 

The intercorrelations are presented 
in Table 1. Forms A and B of the 
short vocabulary test have been com- 
bined to provide an index of the effec- 
tiveness of a longer (40 item) vocabu- 
lary measure. Form A was employed in 
the Intelligence in the United States 
studies. The WAIS Verbal score was 
computed by combining scaled scores 
for the Information, Comprehension, 
Arithmetic, Similarities, and Digit 
Span subtests. 

Table 1 also contains information 
on the mean scores and standard de- 
for each of the The 


viations tests. 
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evidence for selection on intelligence 
or its correlates is marked. On Form 
A, for which we have definite informa- 
tion, the mean score for the population 
as a whole (excluding those aged nine 
and below) is 10.77. The standard de- 
viation is 3.46. 

The difference in means between 
Forms A and B is reliable (t¢ = 5.50, 
p < .01). This finding has been 
checked on a sample of 64 tabulating 
machine operators who also took both 
forms of the test. In this latter group 
the means were 11.59 and 13.45, re- 
spectively, (t = 4.95, p < .01). Thorn- 
dike reports that Form A appears to 
be somewhat easier at the lower levels 
and harder at the higher levels than 
Form B. The results presented here 
are consistent with such a conclusion. 

In view of the known restriction of 
range in the present sample, it seemed 
advisable to estimate the size of the 
correlations that might be expected in 
the population as a whole. Such figures 
are more suitable for evaluating the 
validity of the Intelligence in the 
United States studies which utilized 
a sample representative of the total 
population. They are also more suit- 
able for making comparisons with the 
findings obtained in the studies em- 
ploying longer vocabulary tests, 


TABLE 1 
OBTAINED CORRELATIONS FOR A SELECTED Group or Sates EmMpLoYees 
(N = 108) 


Test 


Vocabulary Test 
Forms A & B 
items) 
Vocabulary Test 
Form A (20 items) 
Vocabulary Test 
Form B (20 items) 
Concept Mastery Test 
WAIS Verbal 


(40 


Vocabulary Test 


Concept 
Mastery 


Form A Form B | 





A SHORT VOCABULARY 
which characteristically were based 
on samples of hospital patients, 
prison inmates, service inductees, un- 
selected school children, or the adult 
population. 

The estimates in Table 2 which in- 
volve the Concept Mastery Test and 
WAIS were computed using the fol- 
lowing formula taken from Gulliksen 
(1950): 


Rxy = V1 — (1 — rsy®)s,2/Sy? 


In this formula, the standard devia- 
tion of the population scores for both 
forms of the vocabulary test (S,) was 
taken as 3.46. In all probability the 
resulting estimates, which average in 
the high .80s and tend generally to 
exceed by a small amount the estimate 
of reliability in the population, are 
somewhat inflated. Apparently the 
standard deviations obtained in the 
selected groups for the two forms of 
the vocabulary test (s,) are under- 


estimated due to ceiling effects. In- 
spection of the distributions suggests, 


however, that the error introduced in 
this manner is not sizable. It seems 
almost certain that the population 
figures would not drop below .75. 
The correlation in Table 2 betweer 
Form A and Form B is an estimate of 
reliability in the population as a whole 
and derived using Gulliksen’s 
Equation 5 (1950, p. 111). This as- 
sumes the two are parallel forms, 
which is apparently, not strictly 
speaking, the case. Nevertheless, the 
figure is consistent with those previ- 
ously reported. A similar estimate was 
derived from the tabulating machine 
operator sample. The corrected reli- 
ability coefficient there was .82. The 
estimates involving Form B are based 
on the assumption that the standard 
deviation in the population is the 
same as for Form A. This assumption 
in all probability yields excessively 
of correlation 


was 


conservative estimates 


TEST OF INTELLIGENCE 


TABLE 2 
EstTimMaTED CORRELATIONS BETWEEN TESTS 
IN THE GENERAL POPULATION 


Vocabu- 
. Concept 
lary Test 
~ Mastery 
Form B ’ 
Test 


20 item 


WAIS 
Verbal 


Vocabulary Test 

Form A_ (20 85 
items ) 

Vocabulary Test 

Form B (# 
items) 


size. Lorge (1957) reports a standard 
deviation of 3.4 for Form A and 4.0 
for Form B among United States 
Army enlisted men. 

The above reference also contains 
information on correlations between 
the short vocabulary tests and the 
Army General Classification Test for 
two representative samples of enlisted 
men. The samples numbered 868 for 
Form A and 883 for Form B. The co- 
efficients were .70 and .77, respectively. 


CONCLUSION 


Taken together the Lorge data and 
the present findings offer rather im- 
pressive support to those who have 
argued for the validity of short vocab- 
ulary tests as measures of intelligence 
The 20-item tests yield correlations 
with the more general measures of in- 
telligence which are comparable to 
those found between the general meas- 
ures themselves. In the population as 
a whole the correlation between the 
short tests and tests of general intel- 
ligence appears to be at least .75. This 
figure compares favorably with that 
of .83 found for the longer and pre- 
sumably somewhat more reliable vo- 
ecabulary tests on which data have 
been reported previously. 

It is hoped that the publication of 
these findings will result in a greater 
use of short vocabulary tests in con- 
nection with research studies where 
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practical considerations have hereto- 
fore precluded the investigation of 
relationships between experimental 
variables and intelligence. Prior as- 
sumptions regarding the impossibility 
of achieving adequate reliability and 
validity in such short measures were 
apparently incorrect. There would 


seem to be little basis for criticizing 
any study on the score of inadequate 
measurement techniques, purely be- 
cause a short verbal measure of in- 
telligence was employed. 
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VISUAL PERCEPTION OF BINARY PATTERNS BY 
PRESCHOOL CHILDREN AND BY 
SCHOOL CHILDREN’ 
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This study attempts to relate the 
appearance of a primacy effect in the 
perceptual span to progress in learn- 
ing to read. The primacy effect, as 
usually defined, is the phenomenon 
that initial elements of a sequential 
task produce fewer errors in stimulus 
reproduction than elements occurring 
later in the sequence. In the deter- 
mination of perceptual spans, the su- 
perior reproduction of elements at the 
left within the visual pattern has often 
been attributed to the development of 
a learned set or tendency to perceive 
first those elements at the left within 


the pattern (Anderson, 1946). There- 


fore, these elements on the left would 
be favored by a primacy effect. Since 


this implied left-to-right viewing se- 
quence is appropriate for reading Eng- 
lish, the thesis of the present paper is 
that it has been developed through 
practice in reading English. By the 
same argument, more accurate repro- 


‘This article is based on a dissertation 
submitted by the senior author to the De- 
partment of Psychology of the College of 
William and Mary in partial fulfillment of 
the requirements for the degree of Master of 
Arts (Dyer, 1960). This investigation was 
supported by PHS Research grants (B-1971 
and B-2661) from the Institute of Neuro- 
logical Diseases and Blindness, United States 
Public Health Service 

*Our thanks are due to Anne Smith, 
Head of the Happy Hours School, Williams- 
burg, Virginia, and to Jeanne Etheridge, 
Principal of the Matthew Whaley Elemen- 
tary School, Williamsburg, Virginia, for 
their kind cooperation and assictance in the 
conduct of this research. The authors also 
wish to thank S. B. Williams and Gertrude 
Johnson for helpful suggestions and critical 
reading of the manuscript 
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duction for stimuli appearing in the 
right visual field would 
right-to-left viewing sequence 
consequently, lesser development 
reading skill. 

Learning or experience has 
found to affect performance on tasks 
which require the perception of spatial 
relationships. For example, the tend- 
ency to make perceptual reversals 
decreases as progress is made in learn- 
ing to read. Smith’s (1950) “retarded” 
readers made approximately 50% 
more reversal errors than did a group 
of “advanced” readers. Similarly, in- 
ferior and superior readers exhibited 
differences in the relative number of 
errors in reproducing tachistoscopic 
letter-stimuli on the two sides of fixa- 
tion (Crosland, 1939). Although the 
superior readers made fewer errors 
overall, for the stimuli in the right 
visual field the inferior readers ex- 
hibited greater accuracy. Nevertheless, 
the averages for both superior and in- 
ferior readers revealed greater accu- 
racy for elements in the left field of 
vision. When Anderson (1946) pre- 
sented nonsense English and Hebrew 
words to bilingual observers, the ob- 
servers recognized more English let- 
ters to the left of fixation, and more 
Hebrew letters to the right of fixation. 
To account for this, Anderson sug- 
gested a learned predisposition to per- 
ceive first the left-hand letters in 
English words, and the right-hand 
letters in Hebrew words—which are, 
of course, read from right to left. 

Heron (1957), also, found fewer 
errors in recognizing English letters 


suggest a 


and, 
In 


been 
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in the left visual field when groups of 
letters were presented on both sides 
of fixation. According to Heron, a 
process involving a spatial-temporal 
analysis of the stimulus trace result- 
ing from even a single glance favors 
the letter-stimuli appearing to the 
left of fixation. This post-exposure 
process, as Heron calls this sequential 
analysis of the afterimage, illustrates 
how sequential viewing habits trans- 
ferred from the reading situation 
might affect the perception of tachisto- 
scopically presented material, as well 
as the perception of material requiring 
successive eye movements. 
Tachistoscopically presented non- 
alphabetical stimuli produce results 
similar to those obtained with groups 
of letters. Hareum (1957), using lin- 
ear patterns of filled and unfilled cir- 
cles, found generally superior repro- 
duction for those elements in the left 
visual field. This result suggests that 
patterns of meaningless forms may be 


used to study the development of a 


so-called normal viewing sequence. 
The use of such stimuli would allow 
the investigation of the basic percep- 
tual mechanism without contamina- 
tion by the meaningfulness, de- 
pendencies, or other discriminating 
characteristics in verbal stimuli. 

The present study investigates the 
development of perceptual organiza- 
tion for visual stimuli using meaning- 
less stimulus-elements simultaneously 
presented on both sides of fixation. 
Two hypotheses are tested: observers 
with no forma] reading training reveal 
little or no difference in reproduction 
accuracy for stimuli in either visual 
field; and observers who have had 
reading training exhibit superior re- 
production of stimuli in the left visual 
field, because they have learned to 
attend first to stimuli in that hemi- 
field when learning to read. 
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METHOD 


children with normal vision 
observers. Nursery school (N 

kindergarten (NV = 18) observers 
enrolled in the private school 
All first grade (NV = 18) and second grade 
(N 17) observers had previously attended 
that private school and were pupils 
at a public elementary All children 
returning signed parental permission slip 
were tested, except for the kindergarten 
children of which only the first 18 were 


SUXty-Ssix 
serve d as 
13) end 


were same 


same 
school 


tested 

iratus was a Dodge-type tachis- 
toscope. The illumination on the stimulus 
field and the fixation field, provided by two 
incandescent light sources, produced a field 
luminance of about 2 foot-Lamberts. The 
ppeared to experience no diffi- 
individual stimulus 


The ap} 


observers 
culty detecting the 
elements 

Each stimulus template consisted of six 
horizontally arranged ellipses. The ellipses 
were 360 inches (31.7’) in height, 315 inches 
(27.8’) in width, and were spaced 400 inches 
(35.3’) apart. Stroke width of the ellipses was 

035 inches (3.1'). The fixation cross 

on the fixation field registered with the 
center of the template at a distance of 26 
inches from the observer's eyes. The target 
field was 4.5 inches (9.9°) square 

Individual patterns were made by black- 
ening one element of the template on the 
left and one element on the right of the 
fixation cross. Each of the six element-posi- 
tions was filled an equal number of times 

Each observer, viewing binocularly, first 
reproduced three practice patterns. Each of 
then observed (in dif- 
with binocular, left-eye, 
viewing. Each observer was 
assigned one of the six possible viewing 
orders of the three viewing conditions. An 
attempt was made to reduce fixational er- 
rors by requiring the observer to report the 
color (which was periodically changed) of 
the fixation cross prior to exposure of the 
pattern. Immediately after each .15-second 
exposure of the pattern the observer pointed 
out on a blank template before him the 
elements that corresponded with the 
he had observed as blackened in the stim- 
ulus. An recorded when an ob- 
incorrectly indicated that an open 
element filled, or when he failed to 
indicate a blackened element 

The intertrial interval was determined by 
the pace at which the 


about 


nine patterns 


ferent 


was 
sequences) 


and mght-eve 


ones 
error was 
server 


was 


observer chose to 
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work. Testing time for each 
usually 15-20 minutes 

\ Snellen Chart to determine 
the visual acuity of the and a 
manoptoscope Was used to check his hand- 
edness and eyedness. Reading readiness of 
the kindergarten observers was indicated by 
performance on Sections 1-4 of the Metro- 
politan Readiness Tests. Teachers’ ratings 
were obtained to estimate the reading pro- 
ficiency of the first and second grade ob- 
servers. Circumstances prevented giving the 
Metropolitan test to the nursery school 
children 


observer was 


was used 


observer 


RESULTS 

The data from the binocular viewing 
condition for the four observer groups 
are shown in Figure 1, in which the 
means of errors per exposure are 
plotted as a function of the element- 
position from the left end of the pat- 
tern. The data for the two monocular 
viewing conditions are not shown be- 
cause they almost exactly duplicate 
the binocular data. 

As would be expected, there is a 
decrease in errors associated with 


the higher educational (maturational) 
levels. 

Since the shapes of the error-curves 
for the nursery school and kindergar- 
ten observers appear basically the 
same, as do the curves for the first 


and second grade observers, the ob- 
servers are categorized for purposes of 
statistical analysis of the hemifield 
differences into two general groups of 
preschool vs. school observers. A small 
difference in errors favoring the right 
visual field appears for the preschool 
observers. When the frequency of ob- 
servers who exhibit superior perform- 
ance to the right of fixation are com- 
pared to the expected frequency 
under the null hypothesis, the ob- 
tained difference is not significant by 
the binomial test (p > .42). However, 
the school children exhibit a consistent 
difference favoring the stimuli in the 
right visual field. This difference, 
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Fic. 1. Means of errors per element-posi- 
tion for each observer group under the bin- 
ocular viewing condition 
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tested as before by the binomial test, 
is significant (p < .012). The marked 
change in the results of preschool and 
school children is especially impressive 
when one considers the wide range of 
developmental stages represented 
within each educational level. For 
example, one child in kindergarten was 
highly proficient in reading, and his 
error-curves were quite similar to 
those of the first and second graders 

The consistent and regular curves 
in Figure 1 represent the averaging 
out of individual differences in the rel- 
ative numbers of errors left and right 
of fixation. However, these differences 
in performance between the left and 
right fields came closer to canceling 
out for the preschool children than for 
the school children. 

The data of the school children ex- 
hibit a decrease in errors at the most 
eccentric element-positions and for 
the elements nearest fixation. These 
curves are similar to those frequently 
seen in the data of adult observers on 
a similar task, except for the pres- 
ence of fewer errors for elements to 
the right of fixation. 

Table 1 presents the comparison of 
the measures of handedness and eyed- 
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TABLE 1 
RELATION OF EYEDNESS AND HANDEDNESS 
Tro ToTaL Errors PER OBSERVER AND 
To PercentTaGe Errors Lert 
OF FIXATION 
Left-eyed Right-eyed 


Handedness Measure 


Total 58.6 
AL 53 


Left 


(N 20) |\(N = 33) 
Total 2.8 53.2 
AL 56 53 


Right 


ness with the total number of errors 
made by each observer, and the per- 
centage of these errors that occurred 
for elements to the left of fixation. 
Neither the total number of errors 
made by an observer, nor the percent- 
age of his errors which were made for 
elements left of fixation, are signifi- 
cantly related to laterality prefer- 
ences. 

Table 2 shows a comparison of rat- 


ings of higher vs. lower reading pro- 
ficiency and the occurrence of higher 


vs. lower relative number of errors 
to the left of fixation. The frequencies 
in this two-way classification are 
based only on the data of the first 
and second grade observers. These 
two classifications are not signifi- 
cantly related (y* = 2.40; p > .05), 
although the difference is in the direc- 
tion of a positive relation between 
relatively more errors left of fixation 
and teachers’ ratings of above average 
reading proficiency. 
Discussion 

The present study provides evi- 
dence in support of the first hypothesis 

that the preschool observers do not 
manifest differences in accuracy of 
performance between the left and 
right hemifields. However, the second 
hypothesis, which specifically predicts 
the development of superiority for ele- 
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ments in the left visual field coincident 
with the onset of instruction in read- 
ing, is not confirmed. Fewer errors 
were made in reproducing stimuli in 
the right visual field, rather than in 
the left visual field. Since this signifi- 
cant difference in the relative number 
of errors appeared rather abruptly 
with the start of schooling, and since 
it was not found in the data of either 
of the two preschool groups, it would 
seem more reasonably due to instruc- 
tion in reading rather than to matura- 
tion. 

Several mechanisms may be 
posed for relating instruction in read- 
ing to superior reproduction for stimuli 
in the right visual field. Children who 
have had instruction in reading may 
tend to look toward the right end of 
the visual pattern (i.e., fixate incor- 
rectly) in this task. But this does not 
seem likely. Similarly, the children 
may have acquired a right-to-left 
viewing sequence in the early stages 
of learning to read, but this also seems 
unlikely. On the other hand, the chil- 
dren may have developed a left-to- 
right scanning sequence as predicted, 
but, for observers of this developmen- 
tal level, recency effects may be 
stronger than primacy effects. This 
latter mechanism seems to be the most 
plausible in view of the small, al- 
though statistically significant, 
positive relationship between ratings 
of reading proficiency and greater 


pro- 


not 


TABLE 2 
RELATION OF READING RATINGS TO THE 
PERCENTAGE ERRORS TO THE LEFT OF 
FIXATION FOR FIRST AND SECOND 
GRADE OBSERVERS 


Above average 
reader 


Average reader 


© Left or below 


Above 50% 9 13 


50% or below 6 7 
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numbers of errors to the left of fixa- 
tion. 


SUMMARY 


Very simple binary patterns were 
observed by nursery school, kinder- 
garten, first grade, and second grade 
school children with left-eye, right- 
eye, and binocular viewing. It was 
hypothesized, on the basis of data 
previously obtained from adult ob- 
servers, that the relative accuracy for 
reproducing elements to the left of 
fixation would with 
training in the left-to-right 
sequence of English. 

The preschool observers exhibited 
nonsignificantly greater accuracy for 
stimuli in the right hemifield. Con- 
trary to the hypothesis, significant 
hemifield superiority was 
the children 


increase school 


re ading 


ob- 


Ap- 


right 


served in school 


parently, perceptual mechanisms of 
children at the age at which they start 
school do not wholly duplicate adult 


mechanisms. 
No important effect of viewing-eye 
condition, or of eyedness, handedness, 
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or “conflicting” eyedness-handedness 
of the observers was found. 


REFERENCES 

Anperson, I. H. The effect of letter-position 
on range of apprehension scores, with 
special reference to reading disability 
U. Mich. Sch. Educ. Bull., 1946, 18, 37 
40 

Cros ann, H. R. Superior elementary-school 
readers contrasted with inferior readers 
in letter-position, “range of attention,” 
scores. J. educ. Res., 1939, 32, 410-427 

Dyer, Dororny W. Perception of binary 
visual patterns by pre-school children 
and by school children. Unpublished 
master’s dissertation, College of William 
and Mary, 1960 

Harcum, E. R. Three inferred factors in the 
visual recognition of binary targets. In 
J. W. Wulfeck & J. H. Taylor (Eds.), 
Form discrimination as related to mili- 
tary problems. (NAS-NRC Publ 561) 
Washington, D. C.: NAS-NRC, 1957 
Pp. 32-37 

Heron, W. Perception as a 
retinal locus and attention 
Psychol , 1957, 70, 38-48 

Smitu, Linpa C. A study of laterality char- 
acteristics of retarded readers and read- 

ezp Educ., 1950, 18, 


function of 


Amer. J 


ing achievers. J 
321-329 


(Received November 4, 1960) 





Journal of Educational Psychology 
1961, Vol. 52, No. 3, 166-172 


FIXED SEQUENCE VERSUS BRANCHING 
AUTOINSTRUCTIONAL METHODS 
HARRY F. SILBERMAN, RALPH J. MELARAGNO, JOHN E. COULSON, 
anp DONALD ESTAVAN 


System Development Corporation 


Two basic autoinstructional meth- 
ods may be identified. The one most 
frequently used displays a fixed se- 
quence of teaching items, requiring all 
subjects to traverse all items (Skin- 
ner, 1958). An alternative method has 
been suggested (Coulson & Silberman, 
1960; Crowder, 1960) which uses a 
variable sequence of items, allowing 
each student to branch to remedial 
materials when needed. 

With a fixed-sequence teaching 
machine, adaptation to individual dif- 
ferences is provided only by the var- 
iable rate at which students move 
through the sequence. Variable-se- 
quence teaching machines provide for 
individual differences by using a va- 
riety of criteria, such as error rate and 
error type, for branching to additional 
remedial items and for skipping over 
redundant items. Each student gen- 
erates his own unique sequence of 
items to effect greater learning effi- 
ciency. The basis for the design of an 
autoinstructional method in which the 
sequence of instructional material is 
tailored to the needs of each student 
is the notion that there is no single 
best item sequence nor one best 
method of presenting the materials. It 
is assumed that different students re- 
quire different items with varying 
amounts of review at different times 
during training. 

Coulson and Silberman (1960) at- 
tempted to evaluate the effectiveness 
of branching versus fixed sequence in- 
structional .methods. Using a manu- 
ally operated machine they compared 
a fixed item sequence with a variable 


sequence in which some items were 
skipped by students who made no er- 
rors. The findings showed that stu- 
dents trained with the very simple 
branching procedure used in that 
study learned as well as students 
trained without branching, and also 
learned in a shorter time. The amount 
of instructional material was not con- 
trolled, since subjects in the branching 
group had skipped certain items seen 
by the fixed-sequence group. In such 
a study, obtained differences can be 
attributed to the difference in items 
presented as well as to the effects of 
adjusting the instructional sequences 
to the needs of individual students. 

In the Coulson and Silberman 
(1960) study, the wishes of the stu- 
dent were not considered in determin- 
ing whether he was branched back to 
preceding items or skipped ahead to 
subsequent material. Nor was error 
rate over a sequence of items used as 
a branching criterion. The branching 
depended entirely on the errors made 
on individual items. 

The present study was concerned 
with two methods of branching. In 
Experiment I, a procedure that per- 
mitted the student to branch at his 
own option was evaluated, while in 
Experiment II the use of errors as a 
branching criterion was attempted. 
The hypothesis tested in Experiment 
I was that optional-branching se- 
quences would be superior to a fixed 
sequence; the hypothesis in Experi- 
ment II was that an error-generated 
branching sequence would be superior 
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to a fixed sequence when identical 
items are used in each sequence. 
EXPERIMENT I 

Two hypotheses relating to optional 
branching were tested. The first was 
that a fixed-sequence program would 
be less effective than the same items 
cast as statements in textbook format 
through which the student could 
branch at his own option. The ease of 
reviewing and the facility for skipping 
ahead with the textbook format were 
the bases of this hypothesis. The sec- 
ond hypothesis was that performance 
on a program which allowed the stu- 
dent to review previous material, one 
item at a time, would also exceed per- 
formance on a fixed-sequence program. 


Procedure 


Students from five high schools in Los 
Angeles County served as paid subjects 
Subjects were obtained from junior and sen- 
ior classes, and with the 
Henmon-Nelson Test of Mental Ability 
(Form A, Grades 9-12). Random assign- 
ment to three treatment groups resulted in 
7 males and 10 females being assigned to 
two groups, and 6 males and 11 females 
being assigned to the third group, providing 
17 subjects in each group 

Sixty-one multiple-choice teaching items 
on some topics in logic were prepared and 
given a preliminary trial in a number of 
secondary schools. Items were revised, typed 
on 5 8 cards, and mounted in loose-leaf 
binders for the experiment. Topics covered 
included simple and compound statements, 
connectives and their combinations, and ar- 
guments. 

Three instructional methods 
The first group, designated “fixed sequence,” 
(Henmon-Nelson Mean = 114.1) received 
the 61 teaching items in a fixed sequence 
Subjects in this group were instructed to 
give a covert response to each item in turn, 
and to compare their answer with the cor- 
rect answer, which was inscribed on the 
back of the card. Subjects were further in- 
structed not to turn back to preceding items 
The second group, designated “back branch- 
ing,” (Henmon-Nelson Mean = 113.1) re- 
ceived the same 61 teaching items but was 
permitted to review preceding items by 


were pretested 


were used 
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backing up one item-card at a time. Sub- 
jects in this group were encouraged to re- 
view earlier material and were instructed 
not to skip any items, so that they would 
each item at least once. The third 
group, designated “textbook,” (Henmon- 
Nelson Mean = 1113) received a type- 
written text produced by rewriting the 
original items. Each item was converted 
from a question into a statement by in- 
corporating the correct answers, eliminating 
distractors and filling in blanks. These state- 
ments were then organized into paragraphs 
Subjects in the third group were instructed 
to study the material in whatever manner 
they chose. All subjects were observed 
through one-way windows to insure that 
they were following directions and, addi- 
tionally, to check on whether subjects in 
the back-branching group exercised the 
branching capability. 

Mastery of the topics covered in the 
teaching session was tested with 24 free-re- 
sponse and 24 multiple-choice test questions 
Half of the questions were similar to the 
actual training materials and half consisted 
of situations which required application or 
transfer of learning. Split-half reliability of 
the posttest was 93 (after Spearman-Brown 
correction). The test was administered im- 
mediately after the training session. 


view 


Results 


Comparison of the criterion scores 
(Table 1) for the textbook and the 
fixed-sequence groups confirms the hy- 
pothesis that the textbook method, 
which permits the student to branch 
at his own option, is superior. The 
second hypothesis, that the back- 
branching method would be superior 
to the fixed-sequence method, was not 
confirmed. 


TABLE 1 
Postrest Scores AND TRAINING TIME 


Time (in 
minutes) 


Criterion 
Posttest 
Treatment 


8.7/32.8)10.7 
9.731.8) 9.6 
6.431.5/11.1 


Fixed Sequence 
Back Branching 
Textbook 
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TABLE 2 
or APTITUDE, TRAINING 
AND PosTTEsT SCORE 


CORRELATIONS 
TIME, 


Back 
Branch- 
ing 


Fixed 


- Textbook 
oequence 


39 
45 
.03 


ate 
ol 
04 


Aptitude vs. Score 45 
Aptitude vs. Time .52*| — 
Time vs. Score 14 


For the first hypothesis, that the 
textbook method would be superior to 
the fixed-sequence method, ¢ = 1.79, 
p < .05. For the second hypothesis, 
that the back-branching method would 
be superior to the fixed-sequence 
method, t = .80, p > .10. 

Correlations of Henmon-Nelson ap- 
titude scores, criterion posttest scores, 
and training times are given in Table 
9 


= 


EXPERIMENT II 


A branching program, using error 
rate as a branching decision criterion 
was compared with a fixed-sequence 
program with instructional materials 
equated for the two groups. It was 
hypothesized that performance of sub- 
jects receiving a branching sequence 
would be with respect to 
scores on a criterion posttest, to that 
of students receiving a fixed sequence. 
“his was predicted on the basis of the 
teaching machine’s responsiveness to 
the student’s performance. By provid- 
ing extra remedial items to students 
who have difficulty, the machine tends 
to minimize the number of items seen 
by the brighter student and to min- 
imize the number of errors on training 
items made by the low aptitude stu- 
dent. The overall effect is intended to 


incre 


superior, 


ase the amount of learning in a 
given time for each individual 
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Method 

Apparat A high speed, general purpose 
digital computer (Bendix G-15), equipped 
with a 600-slide, slide 
jector, and an electric typewriter, was used 
g machine. Each slide contained 
instructional item. Sub- 
1 the typewriter to insert his answer 


random-access pro- 
as i un 
one multiple-choice 
ject use 
and receive knowledge of results 

The 
1 variable sequence of slides from a projec- 
to different 


computer was programed to select 
tor in errors made by 
subject. If 
ber of errors that had been prespecified for 
if topic, he branched to 

s difficult items. If he did poorly 

still 


moving 


response 


subject was exceeding the num- 
would be 


on thi he would be shunted to 


easier sets on the same before 


topi 


to the next topic. Some of the 


on |} 


multiple- 
items contained distractors the choice 
ted a particular 
standing. Subjects who ted 
ranched immediately to 
dial slides designed to clear uy that point 
Instructional Mate Four hundred 
and eleven multiple-choice items logic 
Silberman, Coulson, Melaragno, Estavan, 
& Englund, 1960) prepared and given 
a preliminary trial in a number of secondary 


Items were put 


h indica misunder- 


st le ( these op- 


tions were reme- 
, 
als 


on 


were 


schools revised and 


the 


onto 


35-mm. slides for use random-access 
projector 

Toy ics Cove red by 
nd 


included 
logical 
In- 
diffi- 
level were written 


the se 
statements, 

irgument 
arranged 


items 
ompound 
und 


simple 


connectives six forms 


structional! were into 
culty levels. Items at 
maximum amount of in- 

the most difficult items 
le vel 
tially in the same format as those of the first 
pertinent information was 
stributed over more slides than 
The of the 


third and fourth levels; here 


tems 
one 
so as to contain a 
ind were 


formation, 


The items at the second were essen- 
level except that 
generally d 
at the first level was true 


the 


same 


items were 


designed to be relatively easy to answer, 


in that the ste} between 
small and the 


Subdye 


items was kept 
increased 
students (21 
were selected from 
high sch in Los Angeles County 
had either just graduated or were in 
their last vear of high school Subjects were 
the Henmon-Nelson Test of 
Form A, Grades 9-12) and 
issigned to two groups. Sub- 


prompts were 
Thirty-six males 


and 15 females) four 
Sub- 


jects 


pretested with 

Mental Ability 

were randomly 

jects were naive with respect to the subject 
) used in the lesson 

One 


matter (log 


Proced 


treatment group was d 
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ignated the branching group and the other 
the fixed-sequence or nonbranching group 
Members of the branching group received 
sequences of items determined by the errors 
that were made during the teaching session 
The computer kept cumulative error records 
also a record of errors on individual 
Throughout the session the 


and 
items machine 
selected an appropriate sequence of instruc- 
tional items for student based upon 
error criteria. In this way, the bright student 
given a minimum of material, whil 
the slower student was given extra, remedial 
material on topics in which errors were com- 
mitted 
Each member of the fixed-s 

was paired at random with one 
the branching group. The unique 
of items which each subject in the branching 


each 


was 


juence grou} 
member of 


sequence 


group generated was presented to his mate 
in the fixed-sequence group. Thus, pairs of 
subjects in the fixed-sequence and the 
branching groups received tdentical 
The difference between the 
groups was that the machine was responsive 
to the errors made by subjects in the branch- 
ing group but was not responsive to errors 
made by subjects in the nonbranching group 

If the brighter member of a pair of sub- 
jects was in the branching group, the result- 


item se- 


quences two 


ing sequence was expect d to be too brief to 
provide effective instruction for his mate in 
the fixed-sequence group If the brighter 
member of a pair of subjects was in the 
fixed-sequence group, the which he 
was expected to be than 
him, resulting in time 


sequence 
longer 
wasted 


received 
necessary for 
ind boredom 

Knowledge of results, 
a typewriter printout of the 


which consisted of 
number of the 
both 


time 


correct answer, was the same for 
groups. One subject was trained at a 

Subjects were given an explanation of the 
operation of the equipment and permitted 
to familiarize themselves with the machine 
on the first two introductory In the 
middle of the session, subjects were given a 
short break. Immediately after training was 
completed, the was ad- 
ministered to each subject 
tions were placed on subjects either during 


items 


criterion posttest 
No time restric- 


the training period or during the posttest 

Test. Mastery of the topics 
covered by the training items was tested 
with 51 multiple-choice test items and 44 
free-response test Half of the test 
items were quite similar to the actual train- 
ing materials and the half required 
application or transfer of learning to situa- 


training series 


’ 
Cnterion 


items 
other 


tions not encountered in the 
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TABLE 3 
TRAINING, AND 
PERFORMANCE 


APTITUDE, POSTTRAINING 


Treatment 
Groups* 


Branch 
ing 


Fixed 
Si 


quence 


of Instruc- | M 156.00) 156.00 
Range 69-248 /69-248 


Number 
tional Items 


Training Errors Mu 24.66) 21.94 
SD 17.30) 13.57 


Training Time (min M 78.83) 81.61 
utes) SD 27.34) 29.21 


Henmon-Nelson IQ’s | M 123 .61)122 
SD 19.16, 17.88 


Posttraining Criterion| M 33) 64 
Scores SD 15.93) 16 


* N = 18 for each treatment group 


The split-half reliability of th 
(after Spearman-Brown correction) 


test was 


Results 


Table 3 gives data on the number 
of items traversed by subjects, the 
number of errors instruc- 
tional items, and the training time. 
The mean time required for each item 
was 17 seconds. Table 3 also contains 
information on the Henmon-Nelson 
aptitude pretest and the criterion post- 
test 

Covariance 


made on 


analysis of criterion 
controlling training 
time and aptitude, yielded no signifi- 
cant difference between the branching 
and the fixed-sequence groups 
Intercorrelations of aptitude, crite- 
rion score, training time, and instruc- 
tional errors are given in Table 4 


posttest scores, 


DISCUSSION 


While both experiments were con- 
cerned with branching, they are not 
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TABLE 4 
INTERCORRELATIONS OF APTITUDE, CRITE- 
RION Scores, TRAINING TIME, AND 
INSTRUCTIONAL ERRORS 


Fixed 


Branching »equence 


Aptitude vs. Score .763* .845* 
Aptitude vs. Errors .677* . 769* 
Aptitude vs. Time .833* .407 
Time vs. Score .682* .179 
Errors vs. Score .904* .846* 
Errors vs. Time .793* .472 


*p< li 


directly comparable in that different 
apparatus and procedures were used. 

Overall, the results of Experiment I 
indicate that the relationship between 
flexibility of materials and rate of 
learning favors the flexible materials 
over the fixed sequence. Certain im- 
plications for further exploration are 
evident when this study is compared 
with those by Holland (1960) and 
Cook and Spitzer (1960), which con- 
tain features similar to it. 

With a semester course in introduc- 
tory psychology as his subject matter, 
Holland also used three instructional 
groups. Members of the first group 
were trained in the conventional man- 
ner, with confirmation of the correct 
answer following subject’s overt re- 
sponse. In his second group, subjects 
received no confirmation following 
their response. 

Holland found no difference in per- 
formance between the confirmation 
program and the same program with- 
out the confirmation. Both of these 
programs were superior to a no-re- 
sponse, control program which only 
required subjects to read complete 
statements. Holland interpreted his 
results as lending support for the prin- 
ciple that an overt response has to oc- 
eur for efficient learning. Insofar as 
Holland’s control group can be thought 
of as using a prompting procedure, his 
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results are in support of confirmation 
as a better teaching method. 

Cook and Spitzer (1960) reported 
results of a study using a short list of 
paired-associates which seem to con- 
flict with Holland’s findings. A 2 x 2 
design was employed in which the ex- 
perimental conditions were prompting 
and confirmation, with overt response 
or no response used in each condition. 
Cook and Spitzer concluded that overt 
responses interfered with learning and 
that the prompting procedure was su- 
perior to confirmation because of the 
enforced delay between stimulus and 
response terms in the confirmation 
method. 

The superiority of the textbook 
group over the fixed-sequence group in 
Experiment I lends support to the 
prompting side of the prompting-con- 
firming controversy, when no overt re- 
sponse is required, since the textbook 
condition corresponds to the prompt- 
ing procedure while the fixed-sequence 
condition used a confirmation proce- 
dure. 

Since the three studies involved ma- 
terials which were dissimilar in length 
and quality, it remains for further re- 
search to compare the influences of re- 
sponse requirement, S-R delay, and 
optional selection of material. 

Two possible conclusions can be ob- 
tained from Experiment II. The first 
is that a teaching machine which 
branches on the basis of errors is not 
significantly superior to a machine 
which displays a fixed sequence of 
items. An alternative explanation is 
that the error criteria used for branch- 
ing in this experiment, and the reme- 
dial items to which a student who was 
having difficulty was branched, were 
inefficient and acted to obscure any 
real differences between the two meth- 
ods. Certain of the experimental re- 
sults lend support to the second con- 
clusion. 
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Analysis of the criterion tests shows 
that low aptitude subjects in both 
groups failed to learn much of the 
material. While this had been pre- 
dicted for the fixed-sequence group, 
it also had been expected that mem- 
bers of the branching group, who 
would supposedly receive a sequence 
uniquely tailored to their individual 
needs, would receive the training nec- 
essary to insure their learning the ma- 
terial. This was the case for only two 
(of seven) subjects with low aptitudes 
in the branching group. Both of these 
subjects were frequently branched to 
remedial items, and both scored above 
their group’s mean on the criterion 
test. The five remaining low aptitude 
subjects in the branching group failed 
to score at or near their group’s mean. 
All six subjects in the fixed-sequence 
group with low aptitudes fell well be- 
low their group’s mean. 

Three factors which may account 
for the ineffectiveness of the remedial 
items for low aptitude subjects are: 


the limited variety of these items, the 
inability of subjects to branch out of 
the remedial series when their diffi- 
culties had been resolved, and the in- 


appropriateness of the particular 
measure of individual differences (er- 
rors) used as the criterion for branch- 
ing decisions. 

Since the instructional items in the 
remedial branches were very similar 
to those in the main series, except that 
the subject matter had been divided 
into small steps, the mode of instruc- 
tion in Experiment II was of limited 
versatility. That is, no attempt was 
made to alter the teaching method for 
a given subject who was having dif- 
ficulty. It is postulated that the low 
aptitude subjects who well 
actually received remedial material 
which assisted them, while the low 
aptitude subjects who did poorly were 
not assisted because the machine sim- 


scored 
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ply was not flexible enough to find a 
set of items adequate for them. 

When a low aptitude subject was 
branched to remedial material, no at- 
tempt was made to evaluate the sub- 
ject’s correct responses in order to 
branch him back to the main set of 
items when he demonstrated profi- 
ciency. Instead, subject was obliged to 
remain in the remedial branch until 
he had negotiated all of the items in 
that branch. For many of the low ap- 
titude subjects, this meant that they 
were forced to see more items than 
necessary. 

In Experiment II it was assumed 
that the dimensions of individual dif- 
ferences measured by errors on in- 
structional items interacted with the 
effectiveness of the item sequence pre- 
sented. The machine was, conse- 
quently, programed to treat subjects 
differentially (i.e., giving different 
item sequences) with respect to the 
dimension of error rate. The results 
show that the particular method of 
providing for individual differences 
used in this experiment was not a suf- 
ficient condition for effective learning 
of the logic lesson. Perhaps the com- 
mon principle of teaching that one 
should “provide for individual dif- 
ferences” needs to be qualified with 
the specific conditions for its accom- 
plishment. It may be conjectured that 
some measures such as response la- 
tency or subject’s self-evaluation are 
more appropriate than error rate, and 
that the computer should have con- 
sidered these behavior measures for its 
branching decisions instead of, or in 
addition to, errors. 


SUMMARY 


The experiments investigated the ef- 
fectiveness of two methods of branch- 
ing, as measured by posttraining cri- 
terion tests. In Experiment I, three 
groups of 17 subjects were used to test 
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two hypotheses concerning optional 
branching. A fixed-sequence group re- 
ceived items in fixed order; a back- 
branching group receiving the same 
items as the first group, was permitted 
to back up one item at a time to 
review earlier items; a third group re- 
ceived the same items cast in state- 
ment form and organized into para- 
graphs permitting subjects to choose 
material at their own option. A sig- 
nificant difference on a posttest in 
favor of the third group was obtained 
when the first and third groups were 
compared 

In Experiment II, a computer-con- 
trolled teaching machine was used to 
evaluate the effectiveness of adapting 
sequences of teaching items on logic. 

Members of a branching group re- 
ceived sequences of items determined 
by the errors that were made during 
instruction. Each member of a fixed se- 
quence group was paired at random 
with one member of the branching 
group. The particular sequence of 
items which each subject in the 
branching group received was pre- 
sented to his mate in the fixed-se- 
quence group. Covariance analysis of 
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criterion scores using aptitude and 
training time as control variables 
yielded no significant difference be- 
tween the branching and fixed-se- 


quence conditions. A discussion of the 
limitations of the study and of pos- 
sibilities for further research on this 
problem was presented. 
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A RE-EXAMINATION OF COLLEGE 


ALEXANDER W 


Vert 


National 


Several recent investigations have 
attempted to evaluate what part the 
undergraduate’s educational experi- 
ence plays in stimulating him to go on 
for the PhD degree. The first of these, 
the studies of Knapp and Goodrich 
(1952) and Knapp and Greenbaum 
(1953), defined the productivity of 
any undergraduate college as the per- 
centage of its graduates who eventu- 
ally obtain the PhD. In a subsequent 
study, Holland (1957) showed that an 
institution’s productivity is related in 
part to the academic ability of the 
students who enroll; that is, the highly 
productive institution has a 
proportion of talented students among 
its undergraduates than does the less 
productive institution. Following this 
lead, Thistlethwaite (1959a, 1959b) 
equated colleges with respect to stu- 
dent ability by adjusting each college’s 
PhD productivity rates in terms of its 
“talent supply” (that is, the estimated 
academic ability of the student body) 
He found correlations 83 
between these adjusted productivity 
rates and certain 
press” characteristics of 36 colleges 
Productivity of PhD’s in the natural 
sciences (NS) was correlated with a 
somewhat different set of press than 
was productivity in the arts, humani- 
ties, and social sciences (AHSS). 

The present study attempts to ex- 
tend this work by exploring the fol- 
lowing questions: 


greater 


as high as 


‘environmental 


‘This study is a part of the research 
program at the National Merit Scholarship 
Corporation and was supported by a grant 
from the National Science Foundation 

* The sauthor is indebted to John L 
land, Laura Kent, and Donald L 


thwaite for reviewing the m 


Hol- 
Thistle- 


inuscript 


17: 


PRODUCTIVITY’ 


ASTIN* 


Pet hola ship Corporation 


1. Is ability the only quality of the 
student body which is related to a col- 
productivity? Are there not 
other systematic differences among the 
student bodies enrolling at various in- 
stitutions which are related to PhD 
productivity? One such difference 
might be in the proportion of entering 
students who plan careers in either NS 
or AHSS. Certainly any college which 
is attended predominantly by students 
who plan careers in the natural 
sciences can be expected to have a 
relatively high proportion of gradu- 
ates who go on for the PhD in NS, in- 
dependent of any special effects of the 
college environment. Conversely, this 
same college would probably have a 
low productivity rate of AHSS PhD’s 
Two other characteristics of entering 
students which might affect the pro- 
ductivity of a given school the 
ratio of men to women, and the pro- 
portion of students who already intend 
to get the PhD degree 

2. If the educational 
fields, and sex ratios of entering stu- 
dents are related to productivity, are 
they also responsible in some measure 


lege’s 


are 


goals, 


major 


for the correlations found earlier be- 
tween “college press” and productiv- 
ity? These correlations have been in- 
terpreted as evidence for a causative 
role of the college on the student’s 
motivation; eg., “the results... in- 
dicate that the teacher plays an im- 
portant role in motivating talented 
undergraduates to seek advanced de- 
grees” (Thistlethwaite, 1959a, p. 75); 
“The analysis confirms once again the 
view that one type of college press 
stimulates achievement in the natural 
while a different type fa- 
achievement in the arts, 


sciences, 


cilitates 
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humanities, and social sciences” 
(Thistlethwaite, 1959b, p. 188). How- 
ever, since the information on college 
press came from students at each in- 
stitution, it may reflect differences 
among student bodies which existed 
prior to the students’ entrance into 
college, differences which are not a 
product of any unique qualities of the 
college environment. Before we can 
accurately assess the motivating func- 
tion of the college itself, we must find 
out the extent to which these “pre- 
college” characteristics of the student 
body are related to the college’s pro- 
ductivity. 

Specifically, this study examined: 

1. The extent to which productivity 
rates of NS and AHSS PhD’s (ad- 
justed for talent supply) are a func- 
tion of: (a) the proportion of students 
who, prior to entering college, intend 
to major in natural science; (b) the 
proportion of students who, prior to 
entering college, aspire to the PhD de- 
gree; and (c) the ratio of men to 
women among students enrolling in 
the college. 

2. The extent to which relationships 
previously obtained between adjusted 
PhD productivity and college press are 
modified, when the effects of these 
additional precollege variables are re- 
moved. 


METHOD 


College Input Measures 


Information on three precollege or input 
the student’s sex, probable col- 
lege major, and highest degree aspired to— 
was drawn from a questionnaire which had 
been mailed to a 10% random sample of all 
high school students who scored above the 
64th percentile on the 1959 National Merit 
Scholarship Qualifying Test. Of the students 
who returned the questionnaires, 2,884 at- 
tended one of the 36 institutions 
which college press data had been obtained 
in the The number of stu- 
dents attending each institution ranged from 
15 to 208, with a median of 72 


variables 


about 


earlier studies 
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The following three input measures were 
obtained for each of the 36 colleges: the 
percentage of students who originally 
planned to major in natural science (% NS 
Majors), the percentage of students aspiring 
to the PhD degree (% PhD Aspirants), and 
the percentage of males among the entering 
students (% Males)* 


RESULTS 


Table 1 shows the correlations be- 
tween the three input measures and 
the adjusted productivity indexes of 
the 36 colleges.* It is evident that a 
significant amount of the variation 
in adjusted PhD productivity can still 
be accounted for on the basis of dif- 
ferences among the entering students. 
To obtain a productivity index which 
is independent of the quality of the 
student body, then, requires the use of 
corrections for variables other than 
just aptitude level. 

The intercorrelations of the three 
input variables are given in Table 2. 
To estimate the unique contributions 
of these variables to productivity, 


their partial correlations with produc- 


tivity rates were computed (Table 3). 


make these distributions 
more nearly normal, all percentages were 
converted by means of the arcsin transfor- 
mation (Guilford, 1954, pp. 574-576). Since 
these input measures were based on limited 
samples of the 1959 freshman classes at the 
36 colleges, two checks were made on the 
representativeness of the NMSQT samples 
First, % Males was correlated with the per- 
centage of males among the entire freshman 
class entering each of these 36 institutions 
in Fall, 1958 (as reported by United States 
Office of Education, 1959). This coefficient 
was 97. Second, mean Scholastic Aptitude 
Test which were available on the 
entire 1956 freshman classes enrolling at 22 
of the 36 colleges, were correlated with the 
corresponding mean NMSQT scores of the 
samples. This coefficient was 86 
‘In computing these correlations it is 
necessary to assume that the relative status 
of the 36 colleges on the three input vari- 
ables has not changed greatly over a 10- to 
15-year period. In earlier reports similar 
issumptions were made with respect to tal- 


*In order to 


scores, 


present 


ent supply and “college press.” 
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Table 3 makes it clear that % Males 
relates to neither NS nor AHSS pro- 
ductivity, beyond the combined con- 
tribution of % NS Majors and % 
PhD Aspirants. (This would suggest, 
in addition, that differences in the pro- 
portions of men and women who get 
the PhD can be accounted for by 
differences in their precollege levels 
of aspiration and intended fields of 
study.) These findings prompted the 
decision to omit % Males as an input 
variable, and to deal only with % NS 
Majors and % PhD Aspirants. 

Table 4 shows the correlations of 
% NS Majors and % PhD Aspirants 
with those Faculty and Student Press 
Scales which were previously reported 
as significantly related to adjusted 


TABLE 1 
CORRELATIONS BETWEEN THREE 
VARIABLES AND THE ADJUSTED* 
Propuctivity Rates or 36 
INSTITUTIONS 


INPUT 
PhD 


Adjusted Productivity in 
Natural Science (NS 
Adjusted Productivity in 
Arts, Humanities, and 
(AHSS 


Social Science 


* “Adjusted” productivity is defined as the dis 
crepancy between a college's expected rate of pro 
ducing PhD’s (as predicted from its talent supply 
and ite actual productivity rate (Thistlethwaite 
1959b 


"p< 01 


TABLE 2 
INTERCORRELATIONS OF THREE 
InpuT VARIABLES 


% PhD 


Aspirants 


46** 


% NS Majors 
% PhD Aspirants 


**p < .0l 


TABLE 3 
SEcOND-ORDER PARTIAL CORRELATIONS 
SHOWING THE INDEPENDENT CONTRI 

BUTION OF Eacu INPUT VARIABLE 
To ApsusTep PhD Propvuctivirty 


Input Variables 


% NS C 
Majors 


PhD P 


Aspirants o Males 


Adjusted NS .41* 
Productivity 

Adjusted AHSS | —.83** 
Productivity 


54** .03 


66** .00 


*p< 05 
"p< 01 


TABLE 4 
CoRRELATIONS OF Two INnpuT VARIABLES 
with 13 CoL_itece Press ScALES AT 
36 INSTITUTIONS 


Ing ut Variable 


NS PhD 
rs Aspirants 


Student Press 
Humanism 
Breadth of interests 
Reflectiveness 
Participation 
Aggression 
Scientism 
Social conformity 
aculty 
Excellence of social sci 

faculty and re 
sources 

Flexibility of curriculum 

Energy and controver 
siality of instruction 

Informality and warmth 
of student-faculty con 
tacts 

Closeness of supervision 

Directiveness of teaching 
methods 


Press 


ence 


05 


productivity rates (Thistlethwaite, 
1959b, pp. 187-188). Nine of the 13 
college press scales are significantly 
(p < .01) related to one or both of the 
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TABLE 5 
CONTRIBUTION OF Two INPUT VARIABLES TO CORRELATIONS BETWEEN COLLEGE 


PRESS AND ADJUSTED 


Adjusted NS Productivity 


Original 
Correlation* 


Student Press 
Humanism 
Breadth of interests 
Reflectiveness 
Participation 
Aggression 
Scientism 
Social conformity 
Vaculty Press 
Excellence of social science fac 
ulty and resources 
Flexibility of curriculum 
Energy and controversiality of 
instruction 
Informality and warmth of stu 
dent-faculty contacts 
Closeness of supervision 
Directiveness of teaching meth- 


ods 


* From 187-188) 


> Independent of % 


Thistlethwaite (1959b, pp 
NS Majors and % 


05 


01 


P< 
Pp « 


input variables, and three of the other 


four press scales have borderline (p - 
.05) relationships with input. 

In to the effects of 
these input from the 
correlations previously obtained be- 
tween college presses and PhD pro- 
ductivity, second-order partial cor- 
relations computed. Table 
shows these correlations, along with 
the original correlations given in the 
earlier report. ° It can be seen that all 
the larger correlations tended to 
shrink when the two input variables 
were partialed out. Of the 11 pre- 
viously significant (p < .01) correla- 


remove 
variables 


order 
two 


were 5 


Second-order partial correlations in a 
relatively small sample such as this should 
be regarded rough approximations 
They are presented here only to show trends 
in the effects of student input on the orig- 


as 


very 


inal correlations 


PaD Propvuctivity 
Adjusted AHSS Productivity 


Original 


Partial 
. o t 
orrelation 


Correlation” 


Partial | 
Correlation” 


to \O & bo bo 
= CO * 
* 


0 © 


PhD Aspirants 


© These correlations were inadvertently interchanged in the 


original report 


tions, only one (between AHSS Pro- 
ductivity and “Excellence of social 
faculty and resources”) re- 
significant; five of these, all 
AHSS Productivity, were 
reduce borderline _ significance 
(p > .01, <.05), and five to nonsignifi- 
eance. In addition, all five previously 
borderline correlations were reduced to 
nonsignificance. The only reversals of 
the trend toward shrinkage were two 
previously nonsignificant correlations 
with NS Productivity, which became 
borderline as a result of the partialing 


science 
mained 
involving 


| to 


procedure 


DISCUSSION 


These findings seem to warrant two 
conclusions. First of all, adjusting the 
productivity rates of undergraduate 


institutions solely in terms of differ- 
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ences in the aptitude levels of their 
students does not result in productivity 
indexes which are independent of stu- 
dent quality. At least two other char- 
acteristics of entering student bodies 

the percentage planning to major in 
NS and the percentage aspiring to the 
PhD degree—are significantly related 
to adjusted productivity Sec- 
ondly, these input variables account 
for a substantial share of the relation- 
ships previously found between college 
and adjusted produc- 


rates 


environments 


tivity. In short, much of the variation 
in PhD productivity which had been 
previously attributed to the motivat- 


ing effects of the colleges now appears 
to be a function of diffe among 
the student bodies which enr« 

An additional posed by 
these analyses concerned the justifica- 
tion for using two 
dexes. The high correlations of 
Majors with both productivity 
(Table at breaking 
down productivity in this way 
extraneous va 
differences in the students’ 
interest. To check this 
directly, the difference: 
school’s productivity rates 
tained (that is, NS rate AHSS 
rate). The correlation between this 
difference score and % NS Majors was 
84. In light of this finding, the total 
PhD productivity rate 
1959b, p. 184) 

colle prt The 
correlation between total produc tivity 
and % PhD Aspirants was 81. (‘ 
Males and % NS Majors wer 
significantly related to total produc- 
tivity.) It seems apparent that 
two-thirds of th variation 
total PhD 


productivity can be accounted for on 


rences 


1] 


quest 10n 


productivity in- 
% NS 
rates 
1) suggested tl 
intro- 
due to 


fields of 


duces riability 


notion more 
betwee n each 


was ob- 


(unadjusted) 
Thistlethwaite, 
was computed for each 


fsee 


not 


then, 


about 


aa 
among these 36 colleges in 


the basis of a single input variable 
These findings have several impli- 
For one thing, 


cations they highlight 


one of the difficulties in attempting to 
assess the influence of the college on 
its students: differential “effects” of 
may well turn out to be 
unless the relevant student 
controlled. For 
these results suggest that it 


colleges 
spurious, 
input 
another, 
may be necessary to reinterpret some 
of the results of other studies, not only 
more recent lege 
(Thistlethwaite, 1960), 
which utilize adjusted college produc- 
tivity rates (e.g., Hoiland, 1960) 
From the available evidence, it is 
not clear whether or to what extent the 
undergraduate institution 
or inhibits PhD productivity. The high 
correlations found between input and 
that the 


variables are 


ones of col 


but also those 


~ pre ss” 


stimulates 


productivity indicate college 
plays a relatively smaller role in this 
sample than was previously supposed ; 
nowever we would have to study 
larger samples of students and colleges 
could 


contributions of 


precisely 
input 
ironments 


hefore we determine 


tl lative 
and 


Moreover, since this sample of colleges 


( re 
variables college nv 
is far from representative,® due caution 
should be used in attempting to gen- 
eralize the results to other institutions 


SUMMARY 
The PhD-producing rates of 36 col- 
leges were subjected to further study 
It was shown that a college’s produc- 
related to character- 
entering students other 
their ability ; 
percentage planning to 


tivitv rates are 
istics oOo! its 
than 


name ly, the 


just academic 
major in natural science and the per- 
centage aspiring to the PhD degree 
When the effects of these two input 
variables are partialed out, correla- 
tions previously obtained between col- 
lege press and productivity rates are 
reduced considerably in size 

These 36 colleges were selected initially 
relatively 


Scholars 


attended by 


National Merit 


use they were 


irge numbers of 
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